2015-03-13 10:04:16,867 INFO platform.PlatformRunner (PlatformRunner.java:getPlatformClassesFromClasspath(187)) - found 1 test platforms from classpath
2015-03-13 10:04:16,903 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(237)) - installing platform: hadoop2-mr1
2015-03-13 10:04:16,903 INFO platform.PlatformRunner (PlatformRunner.java:addPlatform(238)) - running test: cascading.JoinFieldedPipesPlatformTest
2015-03-13 10:04:16,920 INFO hadoop2.Hadoop2MR1Platform (Hadoop2MR1Platform.java:setUp(117)) - using cluster
2015-03-13 10:04:17,461 WARN util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Formatting using clusterid: testClusterID
2015-03-13 10:04:17,510 INFO namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:04:17,511 INFO namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:04:17,513 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.configured.node.mapping is deprecated. Instead, use net.topology.configured.node.mapping
2015-03-13 10:04:17,513 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:04:17,517 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:04:17,517 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:17,518 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:04:17,518 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^21 = 2097152 entries
2015-03-13 10:04:17,524 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:04:17,525 INFO blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication = 3
2015-03-13 10:04:17,525 INFO blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication = 512
2015-03-13 10:04:17,526 INFO blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication = 1
2015-03-13 10:04:17,527 INFO blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams = 2
2015-03-13 10:04:17,527 INFO blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks = false
2015-03-13 10:04:17,528 INFO blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:04:17,528 INFO blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer = false
2015-03-13 10:04:17,536 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner = soberoi (auth:SIMPLE)
2015-03-13 10:04:17,537 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup = supergroup
2015-03-13 10:04:17,537 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:04:17,538 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:04:17,541 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:04:17,827 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:04:17,827 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:17,827 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:04:17,828 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^20 = 1048576 entries
2015-03-13 10:04:17,829 INFO namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:04:17,832 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:04:17,832 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:04:17,833 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension = 0
2015-03-13 10:04:17,834 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:04:17,835 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:04:17,837 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:04:17,837 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:17,837 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:04:17,837 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^15 = 32768 entries
2015-03-13 10:04:17,876 INFO common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1 has been successfully formatted.
2015-03-13 10:04:17,877 INFO common.Storage (NNStorage.java:format(527)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2 has been successfully formatted.
2015-03-13 10:04:17,886 INFO namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:04:17,886 INFO namenode.FSImage (FSImageFormat.java:save(976)) - Saving image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 using no compression
2015-03-13 10:04:17,895 INFO namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:04:17,895 INFO namenode.FSImage (FSImageFormat.java:save(1004)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current/fsimage.ckpt_0000000000000000000 of size 199 bytes saved in 0 seconds.
2015-03-13 10:04:17,902 INFO namenode.NNStorageRetentionManager (NNStorageRetentionManager.java:getImageTxIdToRetain(177)) - Going to retain 1 images with txid >= 0
2015-03-13 10:04:17,933 WARN impl.MetricsConfig (MetricsConfig.java:loadFirst(124)) - Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
2015-03-13 10:04:17,975 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:startTimer(344)) - Scheduled snapshot period at 10 second(s).
2015-03-13 10:04:17,976 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:start(183)) - NameNode metrics system started
2015-03-13 10:04:18,018 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2015-03-13 10:04:18,055 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,057 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context hdfs
2015-03-13 10:04:18,058 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,058 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,069 INFO http.HttpServer (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:18,080 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60684
2015-03-13 10:04:18,080 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:18,101 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/hdfs to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60684_hdfs____.4wjvdq/webapp
2015-03-13 10:04:18,333 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60684
2015-03-13 10:04:18,334 INFO namenode.NameNode (NameNode.java:setHttpServerAddress(439)) - Web-server up at: localhost:60684
2015-03-13 10:04:18,336 INFO namenode.HostFileManager (HostFileManager.java:refresh(304)) - read includes:
HostSet(
)
2015-03-13 10:04:18,336 INFO namenode.HostFileManager (HostFileManager.java:refresh(311)) - read excludes:
HostSet(
)
2015-03-13 10:04:18,337 INFO blockmanagement.DatanodeManager (DatanodeManager.java:<init>(210)) - dfs.block.invalidate.limit=1000
2015-03-13 10:04:18,337 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlocksMap
2015-03-13 10:04:18,337 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:18,337 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 2.0% max memory = 672 MB
2015-03-13 10:04:18,338 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^21 = 2097152 entries
2015-03-13 10:04:18,339 INFO blockmanagement.BlockManager (BlockManager.java:createBlockTokenSecretManager(314)) - dfs.block.access.token.enable=false
2015-03-13 10:04:18,340 INFO blockmanagement.BlockManager (BlockManager.java:<init>(300)) - defaultReplication = 3
2015-03-13 10:04:18,340 INFO blockmanagement.BlockManager (BlockManager.java:<init>(301)) - maxReplication = 512
2015-03-13 10:04:18,340 INFO blockmanagement.BlockManager (BlockManager.java:<init>(302)) - minReplication = 1
2015-03-13 10:04:18,341 INFO blockmanagement.BlockManager (BlockManager.java:<init>(303)) - maxReplicationStreams = 2
2015-03-13 10:04:18,341 INFO blockmanagement.BlockManager (BlockManager.java:<init>(304)) - shouldCheckForEnoughRacks = false
2015-03-13 10:04:18,342 INFO blockmanagement.BlockManager (BlockManager.java:<init>(305)) - replicationRecheckInterval = 3000
2015-03-13 10:04:18,342 INFO blockmanagement.BlockManager (BlockManager.java:<init>(306)) - encryptDataTransfer = false
2015-03-13 10:04:18,342 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(612)) - fsOwner = soberoi (auth:SIMPLE)
2015-03-13 10:04:18,343 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(613)) - supergroup = supergroup
2015-03-13 10:04:18,343 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(614)) - isPermissionEnabled = true
2015-03-13 10:04:18,344 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(628)) - HA Enabled: false
2015-03-13 10:04:18,344 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(665)) - Append Enabled: true
2015-03-13 10:04:18,344 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map INodeMap
2015-03-13 10:04:18,345 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:18,345 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 1.0% max memory = 672 MB
2015-03-13 10:04:18,345 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^20 = 1048576 entries
2015-03-13 10:04:18,346 INFO namenode.NameNode (FSDirectory.java:<init>(173)) - Caching file names occuring more than 10 times
2015-03-13 10:04:18,347 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4362)) - dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2015-03-13 10:04:18,347 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4363)) - dfs.namenode.safemode.min.datanodes = 0
2015-03-13 10:04:18,347 INFO namenode.FSNamesystem (FSNamesystem.java:<init>(4364)) - dfs.namenode.safemode.extension = 0
2015-03-13 10:04:18,348 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(725)) - Retry cache on namenode is enabled
2015-03-13 10:04:18,348 INFO namenode.FSNamesystem (FSNamesystem.java:initRetryCache(733)) - Retry cache will use 0.03 of total heap and retry cache entry expiry time is 600000 millis
2015-03-13 10:04:18,348 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map Namenode Retry Cache
2015-03-13 10:04:18,349 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:18,349 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.029999999329447746% max memory = 672 MB
2015-03-13 10:04:18,349 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^15 = 32768 entries
2015-03-13 10:04:18,353 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:18,356 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:18,359 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current
2015-03-13 10:04:18,360 INFO namenode.FileJournalManager (FileJournalManager.java:recoverUnfinalizedSegments(305)) - Recovering unfinalized segments in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name2/current
2015-03-13 10:04:18,361 INFO namenode.FSImage (FSImage.java:loadFSImage(627)) - No edit log streams selected.
2015-03-13 10:04:18,364 INFO namenode.FSImage (FSImageFormat.java:load(330)) - Loading image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 using no compression
2015-03-13 10:04:18,365 INFO namenode.FSImage (FSImageFormat.java:load(333)) - Number of files = 1
2015-03-13 10:04:18,368 INFO namenode.FSImage (FSImageFormat.java:loadFilesUnderConstruction(815)) - Number of files under construction = 0
2015-03-13 10:04:18,368 INFO namenode.FSImage (FSImageFormat.java:load(365)) - Image file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000 of size 199 bytes loaded in 0 seconds.
2015-03-13 10:04:18,369 INFO namenode.FSImage (FSImage.java:loadFSImage(837)) - Loaded image for txid 0 from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/name1/current/fsimage_0000000000000000000
2015-03-13 10:04:18,372 INFO namenode.FSEditLog (FSEditLog.java:startLogSegment(1010)) - Starting log segment at 1
2015-03-13 10:04:18,424 INFO namenode.NameCache (NameCache.java:initialized(143)) - initialized with 0 entries 0 lookups
2015-03-13 10:04:18,424 INFO namenode.FSNamesystem (FSNamesystem.java:loadFromDisk(571)) - Finished loading FSImage in 74 msecs
2015-03-13 10:04:18,550 INFO namenode.NameNode (NameNodeRpcServer.java:<init>(271)) - RPC server is binding to localhost:0
2015-03-13 10:04:18,563 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60685
2015-03-13 10:04:18,578 INFO namenode.FSNamesystem (FSNamesystem.java:registerMBean(5310)) - Registered FSNamesystemState MBean
2015-03-13 10:04:18,592 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:04:18,592 INFO namenode.FSNamesystem (FSNamesystem.java:getCompleteBlocksTotal(4965)) - Number of blocks under construction: 0
2015-03-13 10:04:18,592 INFO namenode.FSNamesystem (FSNamesystem.java:initializeReplQueues(4475)) - initializing replication queues
2015-03-13 10:04:18,600 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2316)) - Total number of blocks = 0
2015-03-13 10:04:18,600 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2317)) - Number of invalid blocks = 0
2015-03-13 10:04:18,601 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2318)) - Number of under-replicated blocks = 0
2015-03-13 10:04:18,601 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2319)) - Number of over-replicated blocks = 0
2015-03-13 10:04:18,601 INFO blockmanagement.BlockManager (BlockManager.java:processMisReplicatedBlocks(2321)) - Number of blocks being written = 0
2015-03-13 10:04:18,601 INFO hdfs.StateChange (FSNamesystem.java:initializeReplQueues(4480)) - STATE* Replication Queue initialization scan for invalid, over- and under-replicated blocks completed in 8 msec
2015-03-13 10:04:18,602 INFO hdfs.StateChange (FSNamesystem.java:leave(4444)) - STATE* Leaving safe mode after 0 secs
2015-03-13 10:04:18,602 INFO hdfs.StateChange (FSNamesystem.java:leave(4455)) - STATE* Network topology has 0 racks and 0 datanodes
2015-03-13 10:04:18,602 INFO hdfs.StateChange (FSNamesystem.java:leave(4458)) - STATE* UnderReplicatedBlocks has 0 blocks
2015-03-13 10:04:18,618 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:18,618 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60685: starting
2015-03-13 10:04:18,620 INFO namenode.NameNode (NameNode.java:startCommonServices(570)) - NameNode RPC up at: localhost/127.0.0.1:60685
2015-03-13 10:04:18,621 INFO namenode.FSNamesystem (FSNamesystem.java:startActiveServices(886)) - Starting services required for active state
2015-03-13 10:04:18,742 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 0 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2
2015-03-13 10:04:18,808 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:18,809 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:18,813 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60686
2015-03-13 10:04:18,816 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:18,817 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,818 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:18,818 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,819 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,820 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:18,821 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:18,822 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60687
2015-03-13 10:04:18,822 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:18,826 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60687_datanode____.zf60v2/webapp
2015-03-13 10:04:18,930 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60687
2015-03-13 10:04:18,938 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60688
2015-03-13 10:04:18,943 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60688
2015-03-13 10:04:18,951 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:18,956 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:18,961 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:18,963 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:18,963 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60688: starting
2015-03-13 10:04:18,966 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 1 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4
2015-03-13 10:04:18,990 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:18,990 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:18,991 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60689
2015-03-13 10:04:18,991 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:18,993 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:18,994 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:18,995 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:18,995 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:18,996 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:18,999 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,001 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60690
2015-03-13 10:04:19,002 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,013 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60690_datanode____.9tddxi/webapp
2015-03-13 10:04:19,137 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60690
2015-03-13 10:04:19,139 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60692
2015-03-13 10:04:19,141 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60692
2015-03-13 10:04:19,146 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,146 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,147 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,149 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,149 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60692: starting
2015-03-13 10:04:19,151 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 2 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6
2015-03-13 10:04:19,161 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,161 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,162 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1 is not formatted
2015-03-13 10:04:19,162 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3 is not formatted
2015-03-13 10:04:19,162 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,162 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,164 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,164 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,164 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4 is not formatted
2015-03-13 10:04:19,164 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2 is not formatted
2015-03-13 10:04:19,164 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,164 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,181 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:19,182 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:19,183 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60693
2015-03-13 10:04:19,183 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:19,185 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:19,186 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:19,187 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:19,187 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:19,188 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:19,189 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,190 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60694
2015-03-13 10:04:19,190 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,194 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60694_datanode____.t83yrm/webapp
2015-03-13 10:04:19,213 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,213 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,214 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,215 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,215 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,215 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,215 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,216 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,216 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,216 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,216 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,218 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,218 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,228 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current
2015-03-13 10:04:19,228 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current
2015-03-13 10:04:19,228 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current
2015-03-13 10:04:19,228 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current
2015-03-13 10:04:19,233 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,233 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,237 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426272710237 with interval 21600000
2015-03-13 10:04:19,238 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426283284238 with interval 21600000
2015-03-13 10:04:19,238 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,239 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,239 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:04:19,239 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:04:19,239 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:04:19,240 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 11ms
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 10ms
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 11ms
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 11ms
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 12ms
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current...
2015-03-13 10:04:19,250 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 11ms
2015-03-13 10:04:19,251 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current: 0ms
2015-03-13 10:04:19,251 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current...
2015-03-13 10:04:19,251 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current...
2015-03-13 10:04:19,251 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current: 0ms
2015-03-13 10:04:19,252 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current: 0ms
2015-03-13 10:04:19,252 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current...
2015-03-13 10:04:19,252 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:04:19,253 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current: 0ms
2015-03-13 10:04:19,253 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 2ms
2015-03-13 10:04:19,255 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,255 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,264 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1907321454-10.1.1.144-60686-1426266259166
2015-03-13 10:04:19,266 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60686
2015-03-13 10:04:19,267 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1172757413-10.1.1.144-60689-1426266259165
2015-03-13 10:04:19,267 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60689
2015-03-13 10:04:19,269 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,270 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,273 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,273 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,301 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,302 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1172757413-10.1.1.144-60689-1426266259165) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,302 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,302 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1907321454-10.1.1.144-60686-1426266259166) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,314 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60686 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,314 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60689 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,314 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 1 msecs
2015-03-13 10:04:19,314 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,352 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 49 msecs for RPC and NN processing
2015-03-13 10:04:19,352 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@769dac96
2015-03-13 10:04:19,353 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 1 msec to generate and 50 msecs for RPC and NN processing
2015-03-13 10:04:19,353 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@3ce639a2
2015-03-13 10:04:19,357 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,357 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,357 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:19,357 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:19,358 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,358 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:04:19,358 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,358 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:04:19,358 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,358 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,361 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,362 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,372 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60694
2015-03-13 10:04:19,374 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60695
2015-03-13 10:04:19,377 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60695
2015-03-13 10:04:19,382 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,383 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,384 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,384 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,384 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60695: starting
2015-03-13 10:04:19,387 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:startDataNodes(1159)) - Starting DataNode 3 with dfs.datanode.data.dir: file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7,file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8
2015-03-13 10:04:19,387 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,387 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5 is not formatted
2015-03-13 10:04:19,387 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,388 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,388 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6 is not formatted
2015-03-13 10:04:19,389 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,417 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - DataNode metrics system started (again)
2015-03-13 10:04:19,417 INFO datanode.DataNode (DataNode.java:<init>(258)) - Configured hostname is 127.0.0.1
2015-03-13 10:04:19,418 INFO datanode.DataNode (DataNode.java:initDataXceiver(482)) - Opened streaming server at /127.0.0.1:60696
2015-03-13 10:04:19,419 INFO datanode.DataNode (DataXceiverServer.java:<init>(73)) - Balancing bandwith is 1048576 bytes/s
2015-03-13 10:04:19,420 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:19,422 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context datanode
2015-03-13 10:04:19,423 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:19,423 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:19,424 INFO datanode.DataNode (DataNode.java:startInfoServer(312)) - Opened info server at localhost:0
2015-03-13 10:04:19,425 INFO datanode.DataNode (WebHdfsFileSystem.java:isEnabled(157)) - dfs.webhdfs.enabled = false
2015-03-13 10:04:19,426 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60697
2015-03-13 10:04:19,426 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:19,430 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-hdfs/2.2.0/9f20694a2b243f5511f1da3c2812bbb27cef24aa/hadoop-hdfs-2.2.0-tests.jar!/webapps/datanode to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_localhost_60697_datanode____r8y5kx/webapp
2015-03-13 10:04:19,431 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,431 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,431 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,431 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,432 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,432 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,432 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,432 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,434 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,434 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current
2015-03-13 10:04:19,434 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current
2015-03-13 10:04:19,435 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,436 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426286221436 with interval 21600000
2015-03-13 10:04:19,436 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,437 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:04:19,437 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 6ms
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 6ms
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 7ms
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current...
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current: 0ms
2015-03-13 10:04:19,443 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current...
2015-03-13 10:04:19,444 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current: 0ms
2015-03-13 10:04:19,444 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:04:19,444 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,445 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-1589780806-10.1.1.144-60693-1426266259390
2015-03-13 10:04:19,445 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60693
2015-03-13 10:04:19,446 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,446 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,448 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,448 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-1589780806-10.1.1.144-60693-1426266259390) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,449 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60693 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,449 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,450 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:04:19,450 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@7f34784e
2015-03-13 10:04:19,450 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,450 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:19,450 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,450 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:04:19,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,451 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,552 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@localhost:60697
2015-03-13 10:04:19,553 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60698
2015-03-13 10:04:19,556 INFO datanode.DataNode (DataNode.java:initIpcServer(384)) - Opened IPC server at /127.0.0.1:60698
2015-03-13 10:04:19,561 INFO datanode.DataNode (BlockPoolManager.java:refreshNamenodes(148)) - Refresh request received for nameservices: null
2015-03-13 10:04:19,561 INFO datanode.DataNode (BlockPoolManager.java:doRefreshNamenodes(193)) - Starting BPOfferServices for nameservices: <default>
2015-03-13 10:04:19,563 INFO datanode.DataNode (BPServiceActor.java:run(658)) - Block pool <registering> (storage id unknown) service to localhost/127.0.0.1:60685 starting to offer service
2015-03-13 10:04:19,563 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:19,564 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60698: starting
2015-03-13 10:04:19,566 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,566 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7 is not formatted
2015-03-13 10:04:19,566 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,570 INFO common.Storage (Storage.java:tryLock(665)) - Lock on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/in_use.lock acquired by nodename 54873@Edinburgh.local
2015-03-13 10:04:19,570 INFO common.Storage (DataStorage.java:recoverTransitionRead(163)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8 is not formatted
2015-03-13 10:04:19,570 INFO common.Storage (DataStorage.java:recoverTransitionRead(164)) - Formatting ...
2015-03-13 10:04:19,611 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,611 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,611 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,611 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,612 INFO common.Storage (Storage.java:lock(629)) - Locking is disabled
2015-03-13 10:04:19,612 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(120)) - Storage directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849 is not formatted.
2015-03-13 10:04:19,612 INFO common.Storage (BlockPoolSliceStorage.java:recoverTransitionRead(121)) - Formatting ...
2015-03-13 10:04:19,612 INFO common.Storage (BlockPoolSliceStorage.java:format(175)) - Formatting block pool BP-1005356445-10.1.1.144-1426266257849 directory /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current
2015-03-13 10:04:19,614 INFO datanode.DataNode (DataNode.java:initStorage(839)) - Setting up storage: nsid=799921817;bpid=BP-1005356445-10.1.1.144-1426266257849;lv=-47;nsInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0;bpid=BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,614 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current
2015-03-13 10:04:19,614 INFO impl.FsDatasetImpl (FsDatasetImpl.java:<init>(213)) - Added volume - /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current
2015-03-13 10:04:19,615 INFO impl.FsDatasetImpl (FsDatasetImpl.java:registerMBean(1252)) - Registered FSDatasetState MBean
2015-03-13 10:04:19,616 INFO datanode.DirectoryScanner (DirectoryScanner.java:start(325)) - Periodic Directory Tree Verification scan starting at 1426273578616 with interval 21600000
2015-03-13 10:04:19,616 INFO impl.FsDatasetImpl (FsDatasetImpl.java:addBlockPool(1621)) - Adding block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,617 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:04:19,617 INFO impl.FsDatasetImpl (FsVolumeList.java:run(173)) - Scanning block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 8ms
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:run(178)) - Time taken to scan block pool BP-1005356445-10.1.1.144-1426266257849 on /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 8ms
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:addBlockPool(202)) - Total time to scan all replicas for block pool BP-1005356445-10.1.1.144-1426266257849: 8ms
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current...
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current: 0ms
2015-03-13 10:04:19,625 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(104)) - Adding replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current...
2015-03-13 10:04:19,626 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(109)) - Time to add replicas to map for block pool BP-1005356445-10.1.1.144-1426266257849 on volume /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current: 1ms
2015-03-13 10:04:19,626 INFO impl.FsDatasetImpl (FsVolumeList.java:getVolumeMap(113)) - Total time to add all replicas to map: 1ms
2015-03-13 10:04:19,626 INFO datanode.DataNode (BPServiceActor.java:register(618)) - Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 beginning handshake with NN
2015-03-13 10:04:19,627 INFO hdfs.StateChange (DatanodeManager.java:registerDatanode(755)) - BLOCK* registerDatanode: from DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) storage DS-318492837-10.1.1.144-60696-1426266259571
2015-03-13 10:04:19,627 INFO net.NetworkTopology (NetworkTopology.java:add(413)) - Adding a new node: /default-rack/127.0.0.1:60696
2015-03-13 10:04:19,628 INFO datanode.DataNode (BPServiceActor.java:register(631)) - Block pool Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 successfully registered with NN
2015-03-13 10:04:19,628 INFO datanode.DataNode (BPServiceActor.java:offerService(499)) - For namenode localhost/127.0.0.1:60685 using DELETEREPORT_INTERVAL of 300000 msec BLOCKREPORT_INTERVAL of 21600000msec Initial delay: 0msec; heartBeatInterval=3000
2015-03-13 10:04:19,630 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(421)) - Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685 trying to claim ACTIVE state with txid=1
2015-03-13 10:04:19,630 INFO datanode.DataNode (BPOfferService.java:updateActorStatesFromHeartbeat(433)) - Acknowledging ACTIVE Namenode Block pool BP-1005356445-10.1.1.144-1426266257849 (storage id DS-318492837-10.1.1.144-60696-1426266259571) service to localhost/127.0.0.1:60685
2015-03-13 10:04:19,631 INFO blockmanagement.BlockManager (BlockManager.java:processReport(1631)) - BLOCK* processReport: Received first block report from 127.0.0.1:60696 after starting up or becoming active. Its block contents are no longer considered stale
2015-03-13 10:04:19,631 INFO BlockStateChange (BlockManager.java:processReport(1647)) - BLOCK* processReport: from DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0), blocks: 0, processing time: 0 msecs
2015-03-13 10:04:19,632 INFO datanode.DataNode (BPServiceActor.java:blockReport(409)) - BlockReport of 0 blocks took 0 msec to generate and 2 msecs for RPC and NN processing
2015-03-13 10:04:19,633 INFO datanode.DataNode (BPServiceActor.java:blockReport(428)) - sent block report, processed command:org.apache.hadoop.hdfs.server.protocol.FinalizeCommand@613cf3c5
2015-03-13 10:04:19,633 INFO util.GSet (LightWeightGSet.java:computeCapacity(328)) - Computing capacity for map BlockMap
2015-03-13 10:04:19,633 INFO util.GSet (LightWeightGSet.java:computeCapacity(329)) - VM type = 64-bit
2015-03-13 10:04:19,633 INFO util.GSet (LightWeightGSet.java:computeCapacity(330)) - 0.5% max memory = 672 MB
2015-03-13 10:04:19,633 INFO util.GSet (LightWeightGSet.java:computeCapacity(332)) - capacity = 2^19 = 524288 entries
2015-03-13 10:04:19,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:<init>(186)) - Periodic Block Verification Scanner initialized with interval 504 hours for block pool BP-1005356445-10.1.1.144-1426266257849
2015-03-13 10:04:19,634 INFO datanode.DataBlockScanner (DataBlockScanner.java:addBlockPool(265)) - Added bpid=BP-1005356445-10.1.1.144-1426266257849 to blockPoolScannerMap, new size=1
2015-03-13 10:04:19,825 INFO hdfs.MiniDFSCluster (MiniDFSCluster.java:waitActive(1891)) - Cluster is active
2015-03-13 10:04:19,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:19,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:19,905 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:19,932 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60700 dest: /127.0.0.1:60693
2015-03-13 10:04:19,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60701 dest: /127.0.0.1:60696
2015-03-13 10:04:19,939 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001 src: /127.0.0.1:60702 dest: /127.0.0.1:60689
2015-03-13 10:04:19,956 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60702, dest: /127.0.0.1:60689, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 7044000
2015-03-13 10:04:19,957 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:19,957 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,958 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60701, dest: /127.0.0.1:60696, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 8121000
2015-03-13 10:04:19,958 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:19,958 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,959 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60700, dest: /127.0.0.1:60693, bytes: 482042, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 9016000
2015-03-13 10:04:19,959 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:19,959 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:19,962 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:19,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:04:20,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:20,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:20,064 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:20,065 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60703 dest: /127.0.0.1:60696
2015-03-13 10:04:20,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60704 dest: /127.0.0.1:60693
2015-03-13 10:04:20,068 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002 src: /127.0.0.1:60705 dest: /127.0.0.1:60689
2015-03-13 10:04:20,074 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60705, dest: /127.0.0.1:60689, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 4170000
2015-03-13 10:04:20,074 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:20,075 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,075 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60704, dest: /127.0.0.1:60693, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 5174000
2015-03-13 10:04:20,075 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:20,076 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,076 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60703, dest: /127.0.0.1:60696, bytes: 405113, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 6035000
2015-03-13 10:04:20,076 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:20,077 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741826_1002{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:20,078 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:20,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=soberoi:supergroup:rwxr--r--
2015-03-13 10:04:20,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging dst=null perm=null
2015-03-13 10:04:20,324 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceInit(150)) - mkdir: hdfs://localhost:60685/tmp/hadoop-yarn/staging
2015-03-13 10:04:20,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:20,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:20,366 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:04:20,372 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:<init>(75)) - ContainerTokenKeyRollingInterval: 86400000ms and ContainerTokenKeyActivationDelay: 900000ms
2015-03-13 10:04:20,374 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:<init>(77)) - NMTokenKeyRollingInterval: 86400000ms and NMTokenKeyActivationDelay: 900000ms
2015-03-13 10:04:20,376 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStoreEventType for class org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore$ForwardingEventHandler
2015-03-13 10:04:20,377 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.NodesListManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.NodesListManager
2015-03-13 10:04:20,378 INFO resourcemanager.ResourceManager (ResourceManager.java:createScheduler(328)) - Using Scheduler: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler
2015-03-13 10:04:20,404 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.scheduler.event.SchedulerEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher
2015-03-13 10:04:20,405 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationEventDispatcher
2015-03-13 10:04:20,406 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$ApplicationAttemptEventDispatcher
2015-03-13 10:04:20,406 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.rmnode.RMNodeEventType for class org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$NodeEventDispatcher
2015-03-13 10:04:20,417 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - ResourceManager metrics system started (again)
2015-03-13 10:04:20,446 INFO capacity.ParentQueue (ParentQueue.java:setupQueueConfigs(189)) - root, capacity=1.0, asboluteCapacity=1.0, maxCapacity=1.0, asboluteMaxCapacity=1.0, state=RUNNING, acls=ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:*
2015-03-13 10:04:20,446 INFO capacity.ParentQueue (ParentQueue.java:<init>(151)) - Initialized parent-queue root name=root, fullname=root
2015-03-13 10:04:20,452 INFO capacity.LeafQueue (LeafQueue.java:setupQueueConfigs(271)) - Initializing default
capacity = 1.0 [= (float) configuredCapacity / 100 ]
asboluteCapacity = 1.0 [= parentAbsoluteCapacity * capacity ]
maxCapacity = 1.0 [= configuredMaxCapacity ]
absoluteMaxCapacity = 1.0 [= 1.0 maximumCapacity undefined, (parentAbsoluteMaxCapacity * maximumCapacity) / 100 otherwise ]
userLimit = 100 [= configuredUserLimit ]
userLimitFactor = 1.0 [= configuredUserLimitFactor ]
maxApplications = 10000 [= configuredMaximumSystemApplicationsPerQueue or (int)(configuredMaximumSystemApplications * absoluteCapacity)]
maxApplicationsPerUser = 10000 [= (int)(maxApplications * (userLimit / 100.0f) * userLimitFactor) ]
maxActiveApplications = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) * maxAMResourcePerQueuePercent * absoluteMaxCapacity),1) ]
maxActiveAppsUsingAbsCap = 1 [= max((int)ceil((clusterResourceMemory / minimumAllocation) *maxAMResourcePercent * absoluteCapacity),1) ]
maxActiveApplicationsPerUser = 1 [= max((int)(maxActiveApplications * (userLimit / 100.0f) * userLimitFactor),1) ]
usedCapacity = 0.0 [= usedResourcesMemory / (clusterResourceMemory * absoluteCapacity)]
absoluteUsedCapacity = 0.0 [= usedResourcesMemory / clusterResourceMemory]
maxAMResourcePerQueuePercent = 0.1 [= configuredMaximumAMResourcePercent ]
minimumAllocationFactor = 0.875 [= (float)(maximumAllocationMemory - minimumAllocationMemory) / maximumAllocationMemory ]
numContainers = 0 [= currentNumContainers ]
state = RUNNING [= configuredState ]
acls = ADMINISTER_QUEUE:*SUBMIT_APPLICATIONS:* [= configuredAcls ]
nodeLocalityDelay = 0
2015-03-13 10:04:20,453 INFO capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,453 INFO capacity.CapacityScheduler (CapacityScheduler.java:parseQueue(409)) - Initialized queue: root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,454 INFO capacity.CapacityScheduler (CapacityScheduler.java:initializeQueues(307)) - Initialized root queue root: numChildQueue= 1, capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, numApps=0, numContainers=0
2015-03-13 10:04:20,454 INFO capacity.CapacityScheduler (CapacityScheduler.java:reinitialize(271)) - Initialized CapacityScheduler with calculator=class org.apache.hadoop.yarn.util.resource.DefaultResourceCalculator, minimumAllocation=<<memory:1024, vCores:1>>, maximumAllocation=<<memory:8192, vCores:32>>
2015-03-13 10:04:20,478 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.RMAppManagerEventType for class org.apache.hadoop.yarn.server.resourcemanager.RMAppManager
2015-03-13 10:04:20,483 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncherEventType for class org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher
2015-03-13 10:04:20,484 INFO resourcemanager.RMNMInfo (RMNMInfo.java:<init>(63)) - Registered RMNMInfo MBean
2015-03-13 10:04:20,485 INFO util.HostsFileReader (HostsFileReader.java:refresh(84)) - Refreshing hosts (include/exclude) list
2015-03-13 10:04:20,487 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(225)) - Waiting for RM to start...
2015-03-13 10:04:20,487 INFO security.AMRMTokenSecretManager (AMRMTokenSecretManager.java:rollMasterKey(107)) - Rolling master-key for amrm-tokens
2015-03-13 10:04:20,487 INFO security.RMContainerTokenSecretManager (RMContainerTokenSecretManager.java:rollMasterKey(103)) - Rolling master-key for container-tokens
2015-03-13 10:04:20,490 INFO security.NMTokenSecretManagerInRM (NMTokenSecretManagerInRM.java:rollMasterKey(97)) - Rolling master-key for nm-tokens
2015-03-13 10:04:20,498 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:20,498 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context cluster
2015-03-13 10:04:20,498 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:20,499 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:20,499 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /cluster/*
2015-03-13 10:04:20,499 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:20,501 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60706
2015-03-13 10:04:20,501 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:20,504 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/cluster to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60706_cluster____agehuh/webapp
2015-03-13 10:04:20,590 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60706
2015-03-13 10:04:20,591 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /cluster started at 60706
2015-03-13 10:04:20,799 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:20,800 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:20,800 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 1
2015-03-13 10:04:20,802 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:04:20,802 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:20,802 INFO security.RMDelegationTokenSecretManager (RMDelegationTokenSecretManager.java:storeNewMasterKey(85)) - storing master key with keyID 2
2015-03-13 10:04:20,812 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60707
2015-03-13 10:04:20,814 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceTrackerPB to the server
2015-03-13 10:04:20,814 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,814 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60707: starting
2015-03-13 10:04:20,826 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60708
2015-03-13 10:04:20,828 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationMasterProtocolPB to the server
2015-03-13 10:04:20,828 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,828 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60708: starting
2015-03-13 10:04:20,848 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60709
2015-03-13 10:04:20,850 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ApplicationClientProtocolPB to the server
2015-03-13 10:04:20,851 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,851 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60709: starting
2015-03-13 10:04:20,868 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60710
2015-03-13 10:04:20,870 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.api.ResourceManagerAdministrationProtocolPB to the server
2015-03-13 10:04:20,871 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:20,871 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60710: starting
2015-03-13 10:04:21,993 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(238)) - MiniYARN ResourceManager address: 10.1.1.144:60709
2015-03-13 10:04:21,993 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(240)) - MiniYARN ResourceManager web address: Edinburgh.local:60706
2015-03-13 10:04:21,994 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0
2015-03-13 10:04:21,994 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1
2015-03-13 10:04:21,995 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2
2015-03-13 10:04:21,995 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3
2015-03-13 10:04:22,006 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_0
2015-03-13 10:04:22,007 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_1
2015-03-13 10:04:22,007 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_2
2015-03-13 10:04:22,007 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-0_3
2015-03-13 10:04:22,008 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 0
2015-03-13 10:04:22,043 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:22,044 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:22,045 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:22,045 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:22,045 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:22,046 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:22,047 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:22,047 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:22,047 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:22,052 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:22,052 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:22,176 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:22,185 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:22,185 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:22,203 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:04:22,203 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:22,204 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:22,204 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:22,204 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:22,205 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 0 to start...
2015-03-13 10:04:22,215 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60711
2015-03-13 10:04:22,216 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:22,217 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:22,217 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:22,217 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60711: starting
2015-03-13 10:04:22,223 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60711
2015-03-13 10:04:22,223 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60711
2015-03-13 10:04:22,228 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60712
2015-03-13 10:04:22,230 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:22,231 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:22,231 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60712: starting
2015-03-13 10:04:22,232 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60712
2015-03-13 10:04:22,241 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:22,249 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60713
2015-03-13 10:04:22,250 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:22,250 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:22,251 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:22,251 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:22,251 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:22,252 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:22,252 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:22,252 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:22,253 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60714
2015-03-13 10:04:22,253 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:22,255 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60714_node____jvahc6/webapp
2015-03-13 10:04:23,025 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60714
2015-03-13 10:04:23,026 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60714
2015-03-13 10:04:23,041 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:23,053 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:23,054 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60711 httpPort: 60714) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60711
2015-03-13 10:04:23,054 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:23,055 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:23,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60711 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:23,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:23,057 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60711 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:23,059 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60711 clusterResource: <memory:4096, vCores:8>
2015-03-13 10:04:23,211 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0
2015-03-13 10:04:23,212 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1
2015-03-13 10:04:23,212 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2
2015-03-13 10:04:23,213 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3
2015-03-13 10:04:23,224 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_0
2015-03-13 10:04:23,224 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_1
2015-03-13 10:04:23,225 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_2
2015-03-13 10:04:23,225 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-1_3
2015-03-13 10:04:23,226 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 1
2015-03-13 10:04:23,241 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:23,242 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:23,242 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:23,242 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:23,242 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:23,242 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:23,243 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:23,243 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:23,243 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:23,245 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:23,245 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:23,351 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:23,353 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:23,353 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:23,355 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:04:23,355 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:23,356 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:23,356 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:23,356 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:23,357 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 1 to start...
2015-03-13 10:04:23,359 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60715
2015-03-13 10:04:23,361 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:23,361 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:23,362 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:23,362 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60715: starting
2015-03-13 10:04:23,366 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60715
2015-03-13 10:04:23,366 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60715
2015-03-13 10:04:23,367 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60716
2015-03-13 10:04:23,368 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:23,369 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:23,369 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60716: starting
2015-03-13 10:04:23,370 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60716
2015-03-13 10:04:23,372 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:23,373 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60717
2015-03-13 10:04:23,373 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:23,374 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:23,375 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:23,375 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:23,375 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:23,376 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:23,376 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:23,376 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:23,376 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60718
2015-03-13 10:04:23,377 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:23,379 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60718_node____.so1jue/webapp
2015-03-13 10:04:23,607 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60718
2015-03-13 10:04:23,608 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60718
2015-03-13 10:04:23,615 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:23,616 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:23,616 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60715 httpPort: 60718) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60715
2015-03-13 10:04:23,617 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:23,616 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60715 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:23,617 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:23,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60715 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:23,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:23,617 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60715 clusterResource: <memory:8192, vCores:16>
2015-03-13 10:04:24,246 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,362 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0
2015-03-13 10:04:24,363 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1
2015-03-13 10:04:24,363 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2
2015-03-13 10:04:24,363 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3
2015-03-13 10:04:24,378 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_0
2015-03-13 10:04:24,378 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_1
2015-03-13 10:04:24,379 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_2
2015-03-13 10:04:24,379 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-2_3
2015-03-13 10:04:24,379 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 2
2015-03-13 10:04:24,391 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:24,392 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:24,392 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:24,392 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:24,392 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:24,392 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:24,393 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:24,393 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:24,393 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:24,394 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:24,395 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:24,441 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,445 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,496 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:24,498 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:24,498 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:24,501 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:04:24,501 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:24,501 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:24,501 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:24,502 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:24,502 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 2 to start...
2015-03-13 10:04:24,508 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60719
2015-03-13 10:04:24,509 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:24,509 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:24,510 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:24,510 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60719: starting
2015-03-13 10:04:24,513 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60719
2015-03-13 10:04:24,514 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60719
2015-03-13 10:04:24,515 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60720
2015-03-13 10:04:24,517 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:24,517 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:24,517 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60720: starting
2015-03-13 10:04:24,519 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60720
2015-03-13 10:04:24,520 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:24,520 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60721
2015-03-13 10:04:24,520 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:24,521 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:24,521 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:24,522 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:24,522 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:24,522 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:24,522 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:24,523 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:24,523 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60722
2015-03-13 10:04:24,523 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:24,526 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60722_node____5dei5f/webapp
2015-03-13 10:04:24,624 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001
2015-03-13 10:04:24,629 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002
2015-03-13 10:04:24,728 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60722
2015-03-13 10:04:24,729 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60722
2015-03-13 10:04:24,734 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:24,735 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:24,735 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60719 httpPort: 60722) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60719
2015-03-13 10:04:24,735 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60719 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:24,735 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:24,736 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:24,736 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60719 clusterResource: <memory:12288, vCores:24>
2015-03-13 10:04:24,736 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60719 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:24,736 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:25,505 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0
2015-03-13 10:04:25,506 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1
2015-03-13 10:04:25,506 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2
2015-03-13 10:04:25,507 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created localDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3
2015-03-13 10:04:25,519 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_0
2015-03-13 10:04:25,519 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_1
2015-03-13 10:04:25,520 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_2
2015-03-13 10:04:25,520 INFO server.MiniYARNCluster (MiniYARNCluster.java:prepareDirs(292)) - Created logDir in /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-logDir-nm-3_3
2015-03-13 10:04:25,520 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(333)) - Starting NM: 3
2015-03-13 10:04:25,531 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ContainerEventDispatcher
2015-03-13 10:04:25,531 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.application.ApplicationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl$ApplicationEventDispatcher
2015-03-13 10:04:25,531 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizationEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService
2015-03-13 10:04:25,532 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServicesEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
2015-03-13 10:04:25,532 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl
2015-03-13 10:04:25,532 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncherEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainersLauncher
2015-03-13 10:04:25,532 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.ContainerManagerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
2015-03-13 10:04:25,532 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.NodeManagerEventType for class org.apache.hadoop.yarn.server.MiniYARNCluster$CustomNodeManager
2015-03-13 10:04:25,532 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - NodeManager metrics system started (again)
2015-03-13 10:04:25,534 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.event.LogHandlerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.loghandler.NonAggregatingLogHandler
2015-03-13 10:04:25,534 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:validateConf(196)) - per directory file limit = 8192
2015-03-13 10:04:25,648 INFO event.AsyncDispatcher (AsyncDispatcher.java:register(157)) - Registering class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.event.LocalizerEventType for class org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerTracker
2015-03-13 10:04:25,649 WARN containermanager.AuxServices (AuxServices.java:serviceInit(114)) - The Auxilurary Service named 'mapreduce_shuffle' in the configuration is for class class org.apache.hadoop.mapred.ShuffleHandler which has a name of 'httpshuffle'. Because these are not the same tools trying to send ServiceData and read Service Meta Data may have issues unless the refer to the name in the config.
2015-03-13 10:04:25,649 INFO containermanager.AuxServices (AuxServices.java:addService(67)) - Adding auxiliary service httpshuffle, "mapreduce_shuffle"
2015-03-13 10:04:25,652 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(98)) - Using ResourceCalculatorPlugin : null
2015-03-13 10:04:25,653 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(103)) - Using ResourceCalculatorProcessTree : null
2015-03-13 10:04:25,653 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(127)) - Physical memory check enabled: false
2015-03-13 10:04:25,653 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:serviceInit(128)) - Virtual memory check enabled: false
2015-03-13 10:04:25,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:serviceInit(160)) - Initialized nodemanager for null: physical-memory=4096 virtual-memory=8602 virtual-cores=8
2015-03-13 10:04:25,654 INFO server.MiniYARNCluster (MiniYARNCluster.java:serviceStart(343)) - Waiting for NM 3 to start...
2015-03-13 10:04:25,657 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60723
2015-03-13 10:04:25,659 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.api.ContainerManagementProtocolPB to the server
2015-03-13 10:04:25,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(281)) - Blocking new container-requests as container manager rpc server is still starting.
2015-03-13 10:04:25,660 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:25,660 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60723: starting
2015-03-13 10:04:25,664 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setNodeId(189)) - Updating node address : 10.1.1.144:60723
2015-03-13 10:04:25,664 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:serviceStart(292)) - ContainerManager started at /10.1.1.144:60723
2015-03-13 10:04:25,665 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60724
2015-03-13 10:04:25,667 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.yarn.server.nodemanager.api.LocalizationProtocolPB to the server
2015-03-13 10:04:25,667 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:25,667 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60724: starting
2015-03-13 10:04:25,669 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:serviceStart(263)) - Localizer started on port 60724
2015-03-13 10:04:25,670 INFO mapred.IndexCache (IndexCache.java:<init>(47)) - IndexCache created with max memory = 10485760
2015-03-13 10:04:25,670 INFO mapred.ShuffleHandler (ShuffleHandler.java:serviceStart(316)) - httpshuffle listening on port 60725
2015-03-13 10:04:25,671 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:25,671 INFO webapp.WebServer (WebServer.java:serviceStart(60)) - Instantiating NMWebApp at Edinburgh.local:0
2015-03-13 10:04:25,672 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:25,672 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context node
2015-03-13 10:04:25,672 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:25,672 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:25,673 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /node/*
2015-03-13 10:04:25,673 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:25,673 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60726
2015-03-13 10:04:25,673 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:25,677 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/node to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60726_node____rv6ixz/webapp
2015-03-13 10:04:25,916 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60726
2015-03-13 10:04:25,917 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /node started at 60726
2015-03-13 10:04:25,922 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:25,923 INFO util.RackResolver (RackResolver.java:coreResolve(109)) - Resolved 10.1.1.144 to /default-rack
2015-03-13 10:04:25,923 INFO resourcemanager.ResourceTrackerService (ResourceTrackerService.java:registerNodeManager(230)) - NodeManager from node 10.1.1.144(cmPort: 60723 httpPort: 60726) registered with capability: <memory:4096, vCores:8>, assigned nodeId 10.1.1.144:60723
2015-03-13 10:04:25,923 INFO rmnode.RMNodeImpl (RMNodeImpl.java:handle(366)) - 10.1.1.144:60723 Node Transitioned from NEW to RUNNING
2015-03-13 10:04:25,923 INFO security.NMContainerTokenSecretManager (NMContainerTokenSecretManager.java:setMasterKey(71)) - Rolling master-key for container-tokens, got key with id 1649686742
2015-03-13 10:04:25,924 INFO capacity.CapacityScheduler (CapacityScheduler.java:addNode(774)) - Added node 10.1.1.144:60723 clusterResource: <memory:16384, vCores:32>
2015-03-13 10:04:25,924 INFO security.NMTokenSecretManagerInNM (NMTokenSecretManagerInNM.java:setMasterKey(65)) - Rolling master-key for nm-tokens, got key with id :1886638853
2015-03-13 10:04:25,924 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(265)) - Registered with ResourceManager as 10.1.1.144:60723 with total resource of <memory:4096, vCores:8>
2015-03-13 10:04:25,924 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:registerWithRM(267)) - Notifying ContainerManager to unblock new container-requests
2015-03-13 10:04:26,666 INFO hs.JobHistory (JobHistory.java:serviceInit(77)) - JobHistory Init
2015-03-13 10:04:26,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:04:26,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:04:26,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:26,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:04:26,681 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(561)) - Perms after creating 511, Expected: 1023
2015-03-13 10:04:26,681 INFO hs.HistoryFileManager (HistoryFileManager.java:mkdir(564)) - Explicitly setting permissions to : 1023, rwxrwxrwt
2015-03-13 10:04:26,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=soberoi:supergroup:rwxrwxrwt
2015-03-13 10:04:26,685 INFO hs.HistoryFileManager (HistoryFileManager.java:initExisting(580)) - Initializing Existing Jobs...
2015-03-13 10:04:26,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:04:26,691 INFO hs.CachedHistoryStorage (CachedHistoryStorage.java:serviceInit(65)) - CachedHistoryStorage Init
2015-03-13 10:04:26,692 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(207)) - Waiting for HistoryServer to start...
2015-03-13 10:04:26,692 INFO impl.MetricsSystemImpl (MetricsSystemImpl.java:init(151)) - JobHistoryServer metrics system started (again)
2015-03-13 10:04:26,693 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:26,693 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:run(526)) - Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2015-03-13 10:04:26,693 INFO delegation.AbstractDelegationTokenSecretManager (AbstractDelegationTokenSecretManager.java:updateCurrentKey(223)) - Updating the current master key for generating delegation tokens
2015-03-13 10:04:26,696 INFO http.HttpServer (HttpServer.java:addGlobalFilter(525)) - Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2015-03-13 10:04:26,696 INFO http.HttpServer (HttpServer.java:addFilter(503)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context jobhistory
2015-03-13 10:04:26,697 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2015-03-13 10:04:26,697 INFO http.HttpServer (HttpServer.java:addFilter(510)) - Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2015-03-13 10:04:26,697 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /jobhistory/*
2015-03-13 10:04:26,697 INFO http.HttpServer (HttpServer.java:<init>(280)) - adding path spec: /ws/*
2015-03-13 10:04:26,698 INFO http.HttpServer (HttpServer.java:start(687)) - Jetty bound to port 60727
2015-03-13 10:04:26,698 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.26
2015-03-13 10:04:26,700 INFO mortbay.log (Slf4jLog.java:info(67)) - Extract jar:file:/Users/soberoi/.gradle/caches/modules-2/files-2.1/org.apache.hadoop/hadoop-yarn-common/2.2.0/77f18c3d40dcb45b0be2602cfa5115a5edb40db1/hadoop-yarn-common-2.2.0.jar!/webapps/jobhistory to /var/folders/_h/41_y71bx1bx0783m72f26_t80000gn/T/Jetty_Edinburgh_local_60727_jobhistory____dzqaj7/webapp
2015-03-13 10:04:26,876 INFO mortbay.log (Slf4jLog.java:info(67)) - Started SelectChannelConnector@Edinburgh.local:60727
2015-03-13 10:04:26,877 INFO webapp.WebApps (WebApps.java:start(258)) - Web app /jobhistory started at 60727
2015-03-13 10:04:26,895 INFO webapp.WebApps (WebApps.java:start(272)) - Registered webapp guice modules
2015-03-13 10:04:26,901 INFO ipc.Server (Server.java:run(564)) - Starting Socket Reader #1 for port 60728
2015-03-13 10:04:26,903 INFO pb.RpcServerFactoryPBImpl (RpcServerFactoryPBImpl.java:createServer(174)) - Adding protocol org.apache.hadoop.mapreduce.v2.api.HSClientProtocolPB to the server
2015-03-13 10:04:26,903 INFO ipc.Server (Server.java:run(861)) - IPC Server Responder: starting
2015-03-13 10:04:26,903 INFO ipc.Server (Server.java:run(688)) - IPC Server listener on 60728: starting
2015-03-13 10:04:26,906 INFO hs.HistoryClientService (HistoryClientService.java:serviceStart(140)) - Instantiated MRClientService at 10.1.1.144/10.1.1.144:60728
2015-03-13 10:04:28,197 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(224)) - MiniMRYARN ResourceManager address: 10.1.1.144:60709
2015-03-13 10:04:28,198 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(226)) - MiniMRYARN ResourceManager web address: Edinburgh.local:60706
2015-03-13 10:04:28,198 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(228)) - MiniMRYARN HistoryServer address: 10.1.1.144:60728
2015-03-13 10:04:28,199 INFO v2.MiniMRYarnCluster (MiniMRYarnCluster.java:serviceStart(230)) - MiniMRYARN HistoryServer web address: Edinburgh.local:60727
2015-03-13 10:04:28,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:28,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:28,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,217 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:28,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60729 dest: /127.0.0.1:60696
2015-03-13 10:04:28,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60730 dest: /127.0.0.1:60693
2015-03-13 10:04:28,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003 src: /127.0.0.1:60731 dest: /127.0.0.1:60686
2015-03-13 10:04:28,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60731, dest: /127.0.0.1:60686, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 3081000
2015-03-13 10:04:28,226 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,227 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60730, dest: /127.0.0.1:60693, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 4193000
2015-03-13 10:04:28,227 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,228 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60729, dest: /127.0.0.1:60696, bytes: 15, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 5613000
2015-03-13 10:04:28,229 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,229 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,229 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741827_1003{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,232 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:28,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:28,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,238 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:28,240 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60732 dest: /127.0.0.1:60686
2015-03-13 10:04:28,241 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60733 dest: /127.0.0.1:60689
2015-03-13 10:04:28,242 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004 src: /127.0.0.1:60734 dest: /127.0.0.1:60696
2015-03-13 10:04:28,247 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60734, dest: /127.0.0.1:60696, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 3485000
2015-03-13 10:04:28,248 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,248 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,249 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60733, dest: /127.0.0.1:60689, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 4519000
2015-03-13 10:04:28,249 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,250 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,251 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60732, dest: /127.0.0.1:60686, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 6513000
2015-03-13 10:04:28,251 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,252 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,254 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files
2015-03-13 10:04:28,279 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.data.dir is deprecated. Instead, use dfs.datanode.data.dir
2015-03-13 10:04:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.completion.poll.interval is deprecated. Instead, use mapreduce.client.completion.pollinterval
2015-03-13 10:04:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir is deprecated. Instead, use dfs.namenode.name.dir
2015-03-13 10:04:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:28,280 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.dir is deprecated. Instead, use dfs.namenode.checkpoint.dir
2015-03-13 10:04:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files
2015-03-13 10:04:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
2015-03-13 10:04:28,281 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
2015-03-13 10:04:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
2015-03-13 10:04:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.http.address is deprecated. Instead, use dfs.namenode.http-address
2015-03-13 10:04:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
2015-03-13 10:04:28,282 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.progress.monitor.poll.interval is deprecated. Instead, use mapreduce.client.progressmonitor.pollinterval
2015-03-13 10:04:28,283 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
2015-03-13 10:04:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reuse.jvm.num.tasks is deprecated. Instead, use mapreduce.job.jvm.numtasks
2015-03-13 10:04:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.umaskmode is deprecated. Instead, use fs.permissions.umask-mode
2015-03-13 10:04:28,285 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.node.switch.mapping.impl is deprecated. Instead, use net.topology.node.switch.mapping.impl
2015-03-13 10:04:28,290 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:04:28,291 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:04:28,297 INFO property.AppProps (AppProps.java:getAppID(169)) - using app.id: 351D3133F32B4C56AD41C256158277CA
2015-03-13 10:04:28,330 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
2015-03-13 10:04:28,347 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compress is deprecated. Instead, use mapreduce.output.fileoutputformat.compress
2015-03-13 10:04:28,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:28,395 INFO util.Version (Version.java:printBanner(82)) - Concurrent, Inc - Cascading 2.6.3
2015-03-13 10:04:28,397 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:04:28,397 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:28,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt"]
2015-03-13 10:04:28,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle"]
2015-03-13 10:04:28,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:04:28,398 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:04:28,399 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:04:28,399 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...splatform/joininnersingle
2015-03-13 10:04:28,442 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,457 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:28,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:04:28,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:04:28,491 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 1
2015-03-13 10:04:28,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=null
2015-03-13 10:04:28,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:04:28,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:04:28,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:28,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,505 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:28,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60736 dest: /127.0.0.1:60686
2015-03-13 10:04:28,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60737 dest: /127.0.0.1:60693
2015-03-13 10:04:28,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60738 dest: /127.0.0.1:60689
2015-03-13 10:04:28,516 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60738, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 4849000
2015-03-13 10:04:28,516 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,517 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,518 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60737, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 5643000
2015-03-13 10:04:28,518 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,520 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60736, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 7631000
2015-03-13 10:04:28,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,520 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,522 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:28,524 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,526 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar
2015-03-13 10:04:28,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:28,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:28,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:28,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:28,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:28,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:28,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:28,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:28,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:28,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:28,543 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
2015-03-13 10:04:28,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:28,552 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:04:28,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:28,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,567 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split
2015-03-13 10:04:28,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:28,571 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:28,573 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60739 dest: /127.0.0.1:60693
2015-03-13 10:04:28,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60740 dest: /127.0.0.1:60689
2015-03-13 10:04:28,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60741 dest: /127.0.0.1:60696
2015-03-13 10:04:28,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006 src: /127.0.0.1:60742 dest: /127.0.0.1:60686
2015-03-13 10:04:28,584 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60742, dest: /127.0.0.1:60686, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 5649000
2015-03-13 10:04:28,584 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,585 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,586 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60741, dest: /127.0.0.1:60696, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 6720000
2015-03-13 10:04:28,586 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,587 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,587 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60740, dest: /127.0.0.1:60689, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 8540000
2015-03-13 10:04:28,588 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,588 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,589 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60739, dest: /127.0.0.1:60693, bytes: 1817, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 9995000
2015-03-13 10:04:28,589 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,590 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741830_1006{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:28,594 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,602 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:28,604 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60743 dest: /127.0.0.1:60686
2015-03-13 10:04:28,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60744 dest: /127.0.0.1:60693
2015-03-13 10:04:28,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007 src: /127.0.0.1:60745 dest: /127.0.0.1:60696
2015-03-13 10:04:28,612 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60745, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 3980000
2015-03-13 10:04:28,613 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,614 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,614 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60744, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 5345000
2015-03-13 10:04:28,614 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,616 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60743, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 6723000
2015-03-13 10:04:28,616 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,617 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741831_1007{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:28,618 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,619 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:04:28,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:28,626 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.df.interval is deprecated. Instead, use fs.df.interval
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - hadoop.native.lib is deprecated. Instead, use io.native.lib.available
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
2015-03-13 10:04:28,627 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.parallel.copies is deprecated. Instead, use mapreduce.reduce.shuffle.parallelcopies
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.submit.replication is deprecated. Instead, use mapreduce.client.submit.file.replication
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir.minspacekill is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacekill
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile is deprecated. Instead, use mapreduce.task.profile
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.heartbeats.in.second is deprecated. Instead, use mapreduce.jobtracker.heartbeats.in.second
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - user.name is deprecated. Instead, use mapreduce.job.user.name
2015-03-13 10:04:28,628 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.interval is deprecated. Instead, use mapreduce.tasktracker.healthchecker.interval
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.timeout is deprecated. Instead, use mapreduce.task.timeout
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.temp.dir is deprecated. Instead, use mapreduce.cluster.temp.dir
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jar is deprecated. Instead, use mapreduce.job.jar
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.active is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.codec is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.codec
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.merge.percent is deprecated. Instead, use mapreduce.reduce.shuffle.merge.percent
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.filesizes is deprecated. Instead, use mapreduce.job.cache.files.filesizes
2015-03-13 10:04:28,629 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.max.attempts is deprecated. Instead, use mapreduce.map.maxattempts
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.input.buffer.percent
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.cache.levels is deprecated. Instead, use mapreduce.jobtracker.taskcache.levels
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.factor is deprecated. Instead, use mapreduce.task.io.sort.factor
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.instrumentation is deprecated. Instead, use mapreduce.jobtracker.instrumentation
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.userlog.limit.kb is deprecated. Instead, use mapreduce.task.userlog.limit.kb
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowNodeThreshold is deprecated. Instead, use mapreduce.job.speculative.slownodethreshold
2015-03-13 10:04:28,630 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.map.max.skip.records is deprecated. Instead, use mapreduce.map.skip.maxrecords
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.block.size is deprecated. Instead, use dfs.blocksize
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.access.time.precision is deprecated. Instead, use dfs.namenode.accesstime.precision
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.jobhistory.lru.cache.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.hours is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.handler.count is deprecated. Instead, use mapreduce.jobtracker.handler.count
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.reduce.markreset.buffer.percent is deprecated. Instead, use mapreduce.reduce.markreset.buffer.percent
2015-03-13 10:04:28,631 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.sort.mb is deprecated. Instead, use mapreduce.task.io.sort.mb
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.maps is deprecated. Instead, use mapreduce.task.profile.maps
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.min is deprecated. Instead, use dfs.namenode.replication.min
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.edits.dir is deprecated. Instead, use dfs.namenode.edits.dir
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.considerLoad is deprecated. Instead, use dfs.namenode.replication.considerLoad
2015-03-13 10:04:28,632 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.nameserver is deprecated. Instead, use mapreduce.tasktracker.dns.nameserver
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.taskmemorymanager.monitoring-interval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.expiry.interval is deprecated. Instead, use mapreduce.jobtracker.expire.trackers.interval
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.balance.bandwidthPerSec is deprecated. Instead, use dfs.datanode.balance.bandwidthPerSec
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.failures is deprecated. Instead, use mapreduce.job.maxtaskfailures.per.tracker
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
2015-03-13 10:04:28,633 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.jobtracker.split.metainfo.maxsize is deprecated. Instead, use mapreduce.job.split.metainfo.maxsize
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.persist.jobstatus.dir is deprecated. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.attempts is deprecated. Instead, use mapreduce.job.end-notification.retry.attempts
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.threshold.pct is deprecated. Instead, use dfs.namenode.safemode.threshold-pct
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.comparator.class is deprecated. Instead, use mapreduce.job.output.key.comparator.class
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.task-controller is deprecated. Instead, use mapreduce.tasktracker.taskcontroller
2015-03-13 10:04:28,634 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.maxtasks.per.job is deprecated. Instead, use mapreduce.jobtracker.maxtasks.perjob
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.child.log.level is deprecated. Instead, use mapreduce.reduce.log.level
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.max.attempts is deprecated. Instead, use mapreduce.reduce.maxattempts
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.output.compression.codec is deprecated. Instead, use mapreduce.map.output.compress.codec
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.shuffle.input.buffer.percent is deprecated. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.tracker.report.address is deprecated. Instead, use mapreduce.tasktracker.report.address
2015-03-13 10:04:28,635 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - keep.failed.task.files is deprecated. Instead, use mapreduce.task.files.preserve.failedtasks
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.name.dir.restore is deprecated. Instead, use dfs.namenode.name.dir.restore
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.client.keystore.resource is deprecated. Instead, use dfs.client.https.keystore.resource
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - tasktracker.http.threads is deprecated. Instead, use mapreduce.tasktracker.http.threads
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.slowTaskThreshold is deprecated. Instead, use mapreduce.job.speculative.slowtaskthreshold
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.address is deprecated. Instead, use dfs.namenode.backup.address
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.backup.http.address is deprecated. Instead, use dfs.namenode.backup.http-address
2015-03-13 10:04:28,636 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.acls.enabled is deprecated. Instead, use mapreduce.cluster.acls.enabled
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.max.tracker.blacklists is deprecated. Instead, use mapreduce.jobtracker.tasktracker.maxblacklists
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.indexcache.mb is deprecated. Instead, use mapreduce.tasktracker.indexcache.mb
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.attempts.to.start.skipping is deprecated. Instead, use mapreduce.task.skip.start.attempts
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.reduce.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.name is deprecated. Instead, use mapreduce.job.name
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - jobclient.output.filter is deprecated. Instead, use mapreduce.client.output.filter
2015-03-13 10:04:28,637 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions is deprecated. Instead, use dfs.permissions.enabled
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.restart.recover is deprecated. Instead, use mapreduce.jobtracker.restart.recover
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.local.dir is deprecated. Instead, use mapreduce.cluster.local.dir
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.speculative.execution.speculativeCap is deprecated. Instead, use mapreduce.job.speculative.speculativecap
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.safemode.extension is deprecated. Instead, use dfs.namenode.safemode.extension
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.datanode.max.xcievers is deprecated. Instead, use dfs.datanode.max.transfer.threads
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.map.child.log.level is deprecated. Instead, use mapreduce.map.log.level
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.compression.type is deprecated. Instead, use mapreduce.output.fileoutputformat.compress.type
2015-03-13 10:04:28,638 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.retiredjobs.cache.size is deprecated. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.need.client.auth is deprecated. Instead, use dfs.client.https.need-auth
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.dns.interface is deprecated. Instead, use mapreduce.tasktracker.dns.interface
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.task.profile.reduces is deprecated. Instead, use mapreduce.task.profile.reduces
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.https.address is deprecated. Instead, use dfs.namenode.https-address
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - job.end.retry.interval is deprecated. Instead, use mapreduce.job.end-notification.retry.interval
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.job.history.block.size is deprecated. Instead, use mapreduce.jobtracker.jobhistory.block.size
2015-03-13 10:04:28,639 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.child.tmp is deprecated. Instead, use mapreduce.task.tmp.dir
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.replication.interval is deprecated. Instead, use dfs.namenode.replication.interval
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.committer.job.setup.cleanup.needed is deprecated. Instead, use mapreduce.job.committer.setup.cleanup.needed
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.map.tasks.maximum is deprecated. Instead, use mapreduce.tasktracker.map.tasks.maximum
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.edits.dir is deprecated. Instead, use dfs.namenode.checkpoint.edits.dir
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.queue.name is deprecated. Instead, use mapreduce.job.queuename
2015-03-13 10:04:28,640 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.write.packet.size is deprecated. Instead, use dfs.client-write-packet-size
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.jobtracker.taskScheduler is deprecated. Instead, use mapreduce.jobtracker.taskscheduler
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.skip.reduce.max.skip.groups is deprecated. Instead, use mapreduce.reduce.skip.maxgroups
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.permissions.supergroup is deprecated. Instead, use dfs.permissions.superusergroup
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.job.tracker.http.address is deprecated. Instead, use mapreduce.jobtracker.http.address
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.healthChecker.script.timeout is deprecated. Instead, use mapreduce.tasktracker.healthchecker.script.timeout
2015-03-13 10:04:28,641 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.instrumentation is deprecated. Instead, use mapreduce.tasktracker.instrumentation
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.system.dir is deprecated. Instead, use mapreduce.jobtracker.system.dir
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.inmem.merge.threshold is deprecated. Instead, use mapreduce.reduce.merge.inmem.threshold
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - topology.script.number.args is deprecated. Instead, use net.topology.script.number.args
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.reduce.slowstart.completed.maps is deprecated. Instead, use mapreduce.job.reduce.slowstart.completedmaps
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - dfs.secondary.http.address is deprecated. Instead, use dfs.namenode.secondary.http-address
2015-03-13 10:04:28,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.checkpoint.period is deprecated. Instead, use dfs.namenode.checkpoint.period
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.tasktracker.tasks.sleeptime-before-sigkill is deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.compress.map.output is deprecated. Instead, use mapreduce.map.output.compress
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.merge.recordsBeforeProgress is deprecated. Instead, use mapreduce.task.merge.progress.records
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.shuffle.connect.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.connect.timeout
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:28,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
2015-03-13 10:04:28,731 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:28,734 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60746 dest: /127.0.0.1:60686
2015-03-13 10:04:28,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60747 dest: /127.0.0.1:60696
2015-03-13 10:04:28,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008 src: /127.0.0.1:60748 dest: /127.0.0.1:60693
2015-03-13 10:04:28,753 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60748, dest: /127.0.0.1:60693, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 12392000
2015-03-13 10:04:28,754 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:28,755 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,755 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60747, dest: /127.0.0.1:60696, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 13836000
2015-03-13 10:04:28,756 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,758 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,758 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60746, dest: /127.0.0.1:60686, bytes: 97648, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 16503000
2015-03-13 10:04:28,758 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:28,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741832_1008{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:28,763 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:28,764 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0001
2015-03-13 10:04:28,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=null
2015-03-13 10:04:28,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:28,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:28,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:28,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:28,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:28,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:28,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:28,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:28,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:28,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:28,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:28,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:28,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:28,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:28,869 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 1 submitted by user soberoi
2015-03-13 10:04:28,869 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0001
2015-03-13 10:04:28,870 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from NEW to NEW_SAVING
2015-03-13 10:04:28,870 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0001
2015-03-13 10:04:28,874 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0001
2015-03-13 10:04:28,876 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:04:28,876 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,878 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from NEW to SUBMITTED
2015-03-13 10:04:28,881 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0001 from user: soberoi activated in queue: default
2015-03-13 10:04:28,882 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0001 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:04:28,883 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:04:28,883 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0001_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0, currently active: 1
2015-03-13 10:04:28,884 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:04:28,887 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from SUBMITTED to ACCEPTED
2015-03-13 10:04:28,889 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0001 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:28,909 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0001/
2015-03-13 10:04:28,910 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0001
2015-03-13 10:04:28,911 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0001/
2015-03-13 10:04:28,953 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:28,954 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:28,954 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:04:28,954 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0001_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:0, vCores:0>usedCapacity=0.0, absoluteUsedCapacity=0.0, numApps=1, numContainers=0 usedCapacity=0.0 absoluteUsedCapacity=0.0 used=<memory:0, vCores:0> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:28,954 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:04:28,955 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:28,956 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:28,957 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0001 AttemptId: appattempt_1426266260362_0001_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:04:28,957 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:04:28,961 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,962 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:04:28,964 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0001_000001
2015-03-13 10:04:28,974 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0001_000001
2015-03-13 10:04:28,975 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:04:28,993 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:29,000 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000001 by user soberoi
2015-03-13 10:04:29,011 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:29,013 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:29,013 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:29,014 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000001 to application application_1426266260362_0001
2015-03-13 10:04:29,017 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:29,019 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:04:29,019 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:29,022 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0001_000001
2015-03-13 10:04:29,022 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:04:29,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:29,027 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000001
2015-03-13 10:04:29,029 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:29,035 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:29,045 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0001_01_000001.tokens. Credentials list:
2015-03-13 10:04:29,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:29,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:29,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:29,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:29,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:29,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:29,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:29,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:29,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:29,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:29,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:29,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:29,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:29,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:29,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:29,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:29,071 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:29,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:29,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:29,097 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60751, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 2742000
2015-03-13 10:04:29,097 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60750, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 2691000
2015-03-13 10:04:29,142 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0001_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001.tokens
2015-03-13 10:04:29,177 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:29,238 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,239 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,239 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,259 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:29,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:29,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:29,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60754, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 711000
2015-03-13 10:04:29,312 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:29,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:29,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:29,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60751, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 207000
2015-03-13 10:04:29,356 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:29,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:29,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:29,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60755, bytes: 1833, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 254000
2015-03-13 10:04:29,396 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:29,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:29,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:29,423 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60754, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1032480705_837, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 423000
2015-03-13 10:04:29,437 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:29,438 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:29,448 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,449 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,449 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:29,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,474 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:29,475 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:29,550 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001/default_container_executor.sh]
2015-03-13 10:04:29,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003
2015-03-13 10:04:29,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006
2015-03-13 10:04:29,634 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004
2015-03-13 10:04:29,635 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007
2015-03-13 10:04:29,636 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008
2015-03-13 10:04:29,943 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:29,944 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:30,620 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741829_1005 to datanode(s) 127.0.0.1:60696
2015-03-13 10:04:30,945 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:31,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:04:31,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED dst=null perm=null
2015-03-13 10:04:31,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:04:31,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_FAIL dst=null perm=null
2015-03-13 10:04:31,293 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 to 127.0.0.1:60696
2015-03-13 10:04:31,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=null
2015-03-13 10:04:31,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:04:31,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60757 dest: /127.0.0.1:60696
2015-03-13 10:04:31,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:04:31,298 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:04:31,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005 src: /127.0.0.1:60757 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:04:31,300 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741829_1005 size 254067
2015-03-13 10:04:31,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:31,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:04:31,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:31,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:31,659 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60758, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741831_1007, duration: 246000
2015-03-13 10:04:31,947 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:32,430 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:32,435 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0001_000001
2015-03-13 10:04:32,435 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0001 APPATTEMPTID=appattempt_1426266260362_0001_000001
2015-03-13 10:04:32,436 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:04:32,436 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from ACCEPTED to RUNNING
2015-03-13 10:04:32,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:32,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:32,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:32,655 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:32,692 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60764 dest: /127.0.0.1:60689
2015-03-13 10:04:32,693 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60765 dest: /127.0.0.1:60696
2015-03-13 10:04:32,695 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009 src: /127.0.0.1:60766 dest: /127.0.0.1:60693
2015-03-13 10:04:32,708 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60766, dest: /127.0.0.1:60693, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 11034000
2015-03-13 10:04:32,709 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:32,710 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,710 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60765, dest: /127.0.0.1:60696, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 7792000
2015-03-13 10:04:32,710 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:32,711 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,711 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60764, dest: /127.0.0.1:60689, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 13090000
2015-03-13 10:04:32,711 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:32,712 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741833_1009{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:32,718 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:32,948 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:33,644 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,645 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:33,645 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:33,645 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,645 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:04:33,646 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,646 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,647 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:33,647 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:04:33,647 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:04:33,647 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,648 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,648 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:33,648 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:04:33,649 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,649 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:04:33,649 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,650 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,650 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:33,650 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:04:33,650 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0001_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,651 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:04:33,651 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,758 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:33,758 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:33,758 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:33,759 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0001 container=Container: [ContainerId: container_1426266260362_0001_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0001_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,759 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:04:33,759 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:33,948 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,265 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,460 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,489 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,491 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:34,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:34,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:34,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,625 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:34,625 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:34,631 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000006 by user soberoi
2015-03-13 10:04:34,632 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000004 by user soberoi
2015-03-13 10:04:34,633 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000002 by user soberoi
2015-03-13 10:04:34,633 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000003 by user soberoi
2015-03-13 10:04:34,632 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0001_01_000005 by user soberoi
2015-03-13 10:04:34,634 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:34,635 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:34,635 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0001
2015-03-13 10:04:34,634 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:34,634 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:34,634 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:34,635 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000002 to application application_1426266260362_0001
2015-03-13 10:04:34,637 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:34,637 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000003 to application application_1426266260362_0001
2015-03-13 10:04:34,637 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000005 to application application_1426266260362_0001
2015-03-13 10:04:34,638 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000004 to application application_1426266260362_0001
2015-03-13 10:04:34,635 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:34,636 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from NEW to INITING
2015-03-13 10:04:34,639 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0001_01_000006 to application application_1426266260362_0001
2015-03-13 10:04:34,639 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:34,641 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from INITING to RUNNING
2015-03-13 10:04:34,640 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005
2015-03-13 10:04:34,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,643 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,642 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,643 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:04:34,643 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,643 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,644 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,643 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009
2015-03-13 10:04:34,645 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,646 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,646 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000006
2015-03-13 10:04:34,646 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,648 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,648 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,648 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,649 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:34,649 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,649 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,649 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,649 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,649 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,650 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,650 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0001
2015-03-13 10:04:34,650 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:34,650 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0001
2015-03-13 10:04:34,651 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000004
2015-03-13 10:04:34,652 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,653 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,653 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,654 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,654 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,663 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,664 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000002
2015-03-13 10:04:34,665 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,665 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,665 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000003
2015-03-13 10:04:34,667 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,667 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,667 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0001_01_000005
2015-03-13 10:04:34,669 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:34,669 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:34,684 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000004.tokens. Credentials list:
2015-03-13 10:04:34,684 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0001_01_000006.tokens. Credentials list:
2015-03-13 10:04:34,696 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0001_01_000005.tokens. Credentials list:
2015-03-13 10:04:34,696 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0001_01_000003.tokens. Credentials list:
2015-03-13 10:04:34,699 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000002.tokens. Credentials list:
2015-03-13 10:04:34,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:34,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:34,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:34,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:34,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:34,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:34,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:34,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:34,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:34,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:34,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:34,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:34,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:34,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:34,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:34,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:34,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:34,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:34,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:34,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:34,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:34,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:34,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:34,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:34,752 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60769, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1256000
2015-03-13 10:04:34,755 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60770, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1244000
2015-03-13 10:04:34,758 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60771, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1092000
2015-03-13 10:04:34,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60772, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1101000
2015-03-13 10:04:34,764 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,765 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:34,804 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,805 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,806 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,812 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:34,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004.tokens
2015-03-13 10:04:34,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:34,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0001_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006.tokens
2015-03-13 10:04:34,874 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:34,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,953 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:34,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar dst=null perm=null
2015-03-13 10:04:34,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60770, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-420781055_1031, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 736000
2015-03-13 10:04:34,972 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60777, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-65381258_1034, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741829_1005, duration: 756000
2015-03-13 10:04:34,989 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,001 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,024 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60772, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-420781055_1031, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 458000
2015-03-13 10:04:35,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml dst=null perm=null
2015-03-13 10:04:35,033 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60777, bytes: 98412, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-65381258_1034, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741832_1008, duration: 415000
2015-03-13 10:04:35,039 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,039 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,039 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,064 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:35,065 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:35,118 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,118 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,121 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,121 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,126 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,126 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,128 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,128 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,133 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:35,134 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:35,289 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005/default_container_executor.sh]
2015-03-13 10:04:35,297 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002/default_container_executor.sh]
2015-03-13 10:04:35,298 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006/default_container_executor.sh]
2015-03-13 10:04:35,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003/default_container_executor.sh]
2015-03-13 10:04:35,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004/default_container_executor.sh]
2015-03-13 10:04:35,510 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:04:35,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,774 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:35,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,069 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0001_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002.tokens
2015-03-13 10:04:36,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,301 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0001_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003.tokens
2015-03-13 10:04:36,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,536 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:36,657 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0001_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005.tokens
2015-03-13 10:04:36,658 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:36,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,778 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:36,963 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,663 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,663 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,664 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,664 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,781 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:37,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:38,970 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,676 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,787 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:39,971 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,680 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,790 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:40,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,683 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:41,973 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,688 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,688 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,794 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:42,974 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:43,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:43,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60788, bytes: 1317, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 270000
2015-03-13 10:04:43,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:43,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:43,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60789, bytes: 801, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 230000
2015-03-13 10:04:43,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job.split dst=null perm=null
2015-03-13 10:04:43,689 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,689 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,690 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,690 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:43,732 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60788, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 245000
2015-03-13 10:04:43,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60793, bytes: 1833, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 262000
2015-03-13 10:04:43,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,780 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60794, bytes: 1833, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 226000
2015-03-13 10:04:43,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:43,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60789, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 240000
2015-03-13 10:04:43,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:43,805 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60795, bytes: 801, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741830_1006, duration: 213000
2015-03-13 10:04:43,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:43,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60796, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 223000
2015-03-13 10:04:43,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:43,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower-offset.txt dst=null perm=null
2015-03-13 10:04:43,937 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60797, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 223000
2015-03-13 10:04:43,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:43,975 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,196 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60798, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 1431000
2015-03-13 10:04:44,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,216 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60799, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 212000
2015-03-13 10:04:44,218 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0001_m_000002_0_1287431413_1
2015-03-13 10:04:44,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0 dst=null perm=null
2015-03-13 10:04:44,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0 dst=null perm=null
2015-03-13 10:04:44,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002 dst=null perm=null
2015-03-13 10:04:44,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,247 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,266 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000004
2015-03-13 10:04:44,267 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,267 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,268 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000004
2015-03-13 10:04:44,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,269 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,269 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,282 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000004 is : 143
2015-03-13 10:04:44,286 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,288 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60801 dest: /127.0.0.1:60686
2015-03-13 10:04:44,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60802 dest: /127.0.0.1:60689
2015-03-13 10:04:44,292 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011 src: /127.0.0.1:60803 dest: /127.0.0.1:60693
2015-03-13 10:04:44,301 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist for DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,302 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000004
2015-03-13 10:04:44,307 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,307 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000004 from application application_1426266260362_0001
2015-03-13 10:04:44,307 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,307 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,313 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60800 dest: /127.0.0.1:60689
2015-03-13 10:04:44,316 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60804 dest: /127.0.0.1:60696
2015-03-13 10:04:44,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010 src: /127.0.0.1:60805 dest: /127.0.0.1:60693
2015-03-13 10:04:44,330 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60805, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 11670000
2015-03-13 10:04:44,331 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,331 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,331 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60804, dest: /127.0.0.1:60696, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 12533000
2015-03-13 10:04:44,332 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,333 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,333 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60800, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 13841000
2015-03-13 10:04:44,333 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741834_1010{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,340 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0001_m_000003_0_369364749_1
2015-03-13 10:04:44,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0 dst=null perm=null
2015-03-13 10:04:44,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0 dst=null perm=null
2015-03-13 10:04:44,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003 dst=null perm=null
2015-03-13 10:04:44,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,374 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000005
2015-03-13 10:04:44,374 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,375 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,375 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,376 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000004
2015-03-13 10:04:44,376 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,378 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000005
2015-03-13 10:04:44,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,378 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,379 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000004
2015-03-13 10:04:44,379 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:04:44,379 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:04:44,379 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,379 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,380 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:04:44,380 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000004 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:04:44,393 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000005 is : 143
2015-03-13 10:04:44,407 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,408 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000005
2015-03-13 10:04:44,409 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,409 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,410 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000005 from application application_1426266260362_0001
2015-03-13 10:04:44,410 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,410 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,433 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60793, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 247000
2015-03-13 10:04:44,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60806, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 242000
2015-03-13 10:04:44,446 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60807, bytes: 19, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741827_1003, duration: 1287000
2015-03-13 10:04:44,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,460 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:44,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:44,469 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:44,505 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60808 dest: /127.0.0.1:60696
2015-03-13 10:04:44,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60810 dest: /127.0.0.1:60693
2015-03-13 10:04:44,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012 src: /127.0.0.1:60811 dest: /127.0.0.1:60689
2015-03-13 10:04:44,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60809 dest: /127.0.0.1:60689
2015-03-13 10:04:44,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60812 dest: /127.0.0.1:60686
2015-03-13 10:04:44,517 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013 src: /127.0.0.1:60813 dest: /127.0.0.1:60693
2015-03-13 10:04:44,526 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60813, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 7601000
2015-03-13 10:04:44,526 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,527 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,527 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60812, dest: /127.0.0.1:60686, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 7880000
2015-03-13 10:04:44,527 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,528 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,528 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60809, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 9601000
2015-03-13 10:04:44,528 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,529 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741837_1013{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,539 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60811, dest: /127.0.0.1:60689, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 28907000
2015-03-13 10:04:44,540 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,540 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,540 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60810, dest: /127.0.0.1:60693, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 29638000
2015-03-13 10:04:44,541 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60808, dest: /127.0.0.1:60696, bytes: 4, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 30833000
2015-03-13 10:04:44,542 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741836_1012{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,550 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0001_m_000001_0_-1451507588_1
2015-03-13 10:04:44,554 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0001_m_000000_0_-582525044_1
2015-03-13 10:04:44,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0 dst=null perm=null
2015-03-13 10:04:44,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0 dst=null perm=null
2015-03-13 10:04:44,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0 dst=null perm=null
2015-03-13 10:04:44,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001 dst=null perm=null
2015-03-13 10:04:44,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0 dst=null perm=null
2015-03-13 10:04:44,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000 dst=null perm=null
2015-03-13 10:04:44,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,592 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,593 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000003
2015-03-13 10:04:44,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:44,594 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,594 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,594 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000005
2015-03-13 10:04:44,595 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,595 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,595 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000005
2015-03-13 10:04:44,595 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:04:44,595 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:04:44,595 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,596 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,596 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:04:44,596 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:04:44,605 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000003 is : 143
2015-03-13 10:04:44,619 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,620 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,620 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000003
2015-03-13 10:04:44,622 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,622 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000003 from application application_1426266260362_0001
2015-03-13 10:04:44,623 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,623 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,630 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,631 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000002
2015-03-13 10:04:44,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:44,632 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000003
2015-03-13 10:04:44,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:44,633 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:04:44,633 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000003
2015-03-13 10:04:44,633 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:04:44,633 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:04:44,633 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,634 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:44,634 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:04:44,634 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:04:44,644 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000002 is : 143
2015-03-13 10:04:44,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:44,649 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:44,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:44,659 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60814, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 202000
2015-03-13 10:04:44,663 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000002
2015-03-13 10:04:44,671 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:44,671 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,671 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000002 from application application_1426266260362_0001
2015-03-13 10:04:44,671 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,671 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,680 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0001_m_000004_0_-730026302_1
2015-03-13 10:04:44,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0 dst=null perm=null
2015-03-13 10:04:44,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0 dst=null perm=null
2015-03-13 10:04:44,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004 dst=null perm=null
2015-03-13 10:04:44,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/_temporary/attempt_1426266260362_0001_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:44,717 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:44,723 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000006
2015-03-13 10:04:44,723 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:44,724 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:04:44,724 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000006
2015-03-13 10:04:44,724 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:04:44,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,731 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1 dst=null perm=null
2015-03-13 10:04:44,736 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0001_01_000006 is : 143
2015-03-13 10:04:44,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000 dst=null perm=null
2015-03-13 10:04:44,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2015-03-13 10:04:44,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:04:44,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,754 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:44,754 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,755 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000006
2015-03-13 10:04:44,758 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:04:44,759 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000006 from application application_1426266260362_0001
2015-03-13 10:04:44,759 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:44,760 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:44,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001 dst=null perm=null
2015-03-13 10:04:44,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2015-03-13 10:04:44,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002 dst=null perm=null
2015-03-13 10:04:44,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2015-03-13 10:04:44,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003 dst=null perm=null
2015-03-13 10:04:44,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2015-03-13 10:04:44,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:44,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004 dst=null perm=null
2015-03-13 10:04:44,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2015-03-13 10:04:44,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary/1/task_1426266260362_0001_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary dst=null perm=null
2015-03-13 10:04:44,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,813 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,817 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,828 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60803, dest: /127.0.0.1:60693, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 534594000
2015-03-13 10:04:44,828 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,829 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,829 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60802, dest: /127.0.0.1:60689, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 534680000
2015-03-13 10:04:44,829 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,830 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,830 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60801, dest: /127.0.0.1:60686, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 536731000
2015-03-13 10:04:44,830 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,831 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741835_1011{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:44,832 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,837 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:44,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60816 dest: /127.0.0.1:60696
2015-03-13 10:04:44,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60817 dest: /127.0.0.1:60686
2015-03-13 10:04:44,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014 src: /127.0.0.1:60818 dest: /127.0.0.1:60689
2015-03-13 10:04:44,846 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60818, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 2892000
2015-03-13 10:04:44,847 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,847 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60817, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 3114000
2015-03-13 10:04:44,848 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,848 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,849 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60816, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 4746000
2015-03-13 10:04:44,849 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,849 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741838_1014{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:44,851 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist dst=null perm=null
2015-03-13 10:04:44,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:04:44,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist dst=null perm=null
2015-03-13 10:04:44,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:04:44,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1.jhist dst=null perm=null
2015-03-13 10:04:44,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,873 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60819, bytes: 53353, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011, duration: 263000
2015-03-13 10:04:44,874 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:44,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60820 dest: /127.0.0.1:60693
2015-03-13 10:04:44,877 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60821 dest: /127.0.0.1:60686
2015-03-13 10:04:44,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015 src: /127.0.0.1:60822 dest: /127.0.0.1:60696
2015-03-13 10:04:44,884 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60822, dest: /127.0.0.1:60696, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 4117000
2015-03-13 10:04:44,884 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,885 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,885 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60821, dest: /127.0.0.1:60686, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 4997000
2015-03-13 10:04:44,885 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,886 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60820, dest: /127.0.0.1:60693, bytes: 52937, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, duration: 5841000
2015-03-13 10:04:44,886 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741839_1015{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:44,889 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml dst=null perm=null
2015-03-13 10:04:44,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp dst=null perm=null
2015-03-13 10:04:44,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml dst=null perm=null
2015-03-13 10:04:44,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp dst=null perm=null
2015-03-13 10:04:44,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001/job_1426266260362_0001_1_conf.xml dst=null perm=null
2015-03-13 10:04:44,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:44,905 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60823, bytes: 91154, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741833_1009, duration: 399000
2015-03-13 10:04:44,907 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:44,909 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60824 dest: /127.0.0.1:60693
2015-03-13 10:04:44,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60825 dest: /127.0.0.1:60696
2015-03-13 10:04:44,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016 src: /127.0.0.1:60826 dest: /127.0.0.1:60686
2015-03-13 10:04:44,916 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60826, dest: /127.0.0.1:60686, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 2159000
2015-03-13 10:04:44,916 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:44,916 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,917 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60825, dest: /127.0.0.1:60696, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 2807000
2015-03-13 10:04:44,917 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,918 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60824, dest: /127.0.0.1:60693, bytes: 90446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1686244545_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, duration: 3746000
2015-03-13 10:04:44,918 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:44,918 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741840_1016{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:44,920 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1686244545_1
2015-03-13 10:04:44,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:04:44,938 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from RUNNING to FINISHING
2015-03-13 10:04:44,938 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0001
2015-03-13 10:04:44,939 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from RUNNING to REMOVING
2015-03-13 10:04:44,939 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0001
2015-03-13 10:04:44,940 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from REMOVING to FINISHING
2015-03-13 10:04:44,980 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:45,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:45,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000002
2015-03-13 10:04:45,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:45,639 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:04:45,640 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000002
2015-03-13 10:04:45,640 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:04:45,640 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:04:45,640 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,640 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,641 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:04:45,641 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:04:45,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:04:45,726 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000006
2015-03-13 10:04:45,727 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:45,727 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:04:45,727 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000006
2015-03-13 10:04:45,727 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:04:45,727 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:04:45,727 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,728 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:45,728 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:04:45,728 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:04:45,949 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741829_1005 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:04:45,950 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741830_1006 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:04:45,950 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741831_1007 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:04:45,950 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741832_1008 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:04:45,950 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741835_1011 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:04:45,951 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741833_1009 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:04:45,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0001 dst=null perm=null
2015-03-13 10:04:45,982 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:46,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,015 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary
2015-03-13 10:04:46,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/_temporary dst=null perm=null
2015-03-13 10:04:46,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,026 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,027 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,034 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:04:46,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2015-03-13 10:04:46,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 196000
2015-03-13 10:04:46,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2015-03-13 10:04:46,049 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 229000
2015-03-13 10:04:46,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2015-03-13 10:04:46,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2015-03-13 10:04:46,053 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 205000
2015-03-13 10:04:46,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2015-03-13 10:04:46,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,064 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,065 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,073 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:04:46,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2015-03-13 10:04:46,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 200000
2015-03-13 10:04:46,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2015-03-13 10:04:46,079 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 158000
2015-03-13 10:04:46,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2015-03-13 10:04:46,081 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2015-03-13 10:04:46,083 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60830, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 163000
2015-03-13 10:04:46,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2015-03-13 10:04:46,085 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joininnersingle
2015-03-13 10:04:46,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle dst=null perm=null
2015-03-13 10:04:46,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2015-03-13 10:04:46,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00000 dst=null perm=null
2015-03-13 10:04:46,096 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013, duration: 224000
2015-03-13 10:04:46,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2015-03-13 10:04:46,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00001 dst=null perm=null
2015-03-13 10:04:46,101 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012, duration: 223000
2015-03-13 10:04:46,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2015-03-13 10:04:46,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00002 dst=null perm=null
2015-03-13 10:04:46,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2015-03-13 10:04:46,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00003 dst=null perm=null
2015-03-13 10:04:46,108 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60828, bytes: 8, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010, duration: 222000
2015-03-13 10:04:46,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2015-03-13 10:04:46,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininnersingle/part-00004 dst=null perm=null
2015-03-13 10:04:46,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:04:46,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:04:46,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,121 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:46,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60832 dest: /127.0.0.1:60686
2015-03-13 10:04:46,123 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60833 dest: /127.0.0.1:60689
2015-03-13 10:04:46,124 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017 src: /127.0.0.1:60834 dest: /127.0.0.1:60693
2015-03-13 10:04:46,127 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60834, dest: /127.0.0.1:60693, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 1483000
2015-03-13 10:04:46,127 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,128 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,128 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60833, dest: /127.0.0.1:60689, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 2136000
2015-03-13 10:04:46,128 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,129 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,129 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60832, dest: /127.0.0.1:60686, bytes: 19, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 2759000
2015-03-13 10:04:46,129 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,130 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741841_1017{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:46,131 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:46,151 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,155 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:04:46,155 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:04:46,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:04:46,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] starting
2015-03-13 10:04:46,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:46,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:04:46,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:04:46,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost"]
2015-03-13 10:04:46,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] parallel execution is enabled: true
2015-03-13 10:04:46,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] starting jobs: 2
2015-03-13 10:04:46,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper1*upper2*lower] allocating threads: 2
2015-03-13 10:04:46,201 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] starting step: (2/2)
2015-03-13 10:04:46,216 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,226 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:04:46,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:04:46,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:04:46,233 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 2
2015-03-13 10:04:46,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=null
2015-03-13 10:04:46,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:04:46,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:04:46,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,244 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:04:46,246 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60836 dest: /127.0.0.1:60696
2015-03-13 10:04:46,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60837 dest: /127.0.0.1:60693
2015-03-13 10:04:46,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60838 dest: /127.0.0.1:60686
2015-03-13 10:04:46,252 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60838, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 2909000
2015-03-13 10:04:46,253 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,253 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,253 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60837, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 3215000
2015-03-13 10:04:46,254 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,254 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60836, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 4548000
2015-03-13 10:04:46,255 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741842_1018{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:04:46,258 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,259 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar
2015-03-13 10:04:46,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:46,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:46,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:46,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:46,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:46,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:46,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:46,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:46,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:46,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:46,272 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:04:46,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:04:46,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,278 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split
2015-03-13 10:04:46,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,280 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:46,281 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60839 dest: /127.0.0.1:60686
2015-03-13 10:04:46,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60840 dest: /127.0.0.1:60693
2015-03-13 10:04:46,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60841 dest: /127.0.0.1:60689
2015-03-13 10:04:46,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019 src: /127.0.0.1:60842 dest: /127.0.0.1:60696
2015-03-13 10:04:46,289 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60842, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 2269000
2015-03-13 10:04:46,290 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,290 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,290 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60841, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 3135000
2015-03-13 10:04:46,291 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,291 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,291 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60840, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 3957000
2015-03-13 10:04:46,292 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,292 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60839, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 4991000
2015-03-13 10:04:46,293 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741843_1019{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,295 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,301 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:04:46,303 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60843 dest: /127.0.0.1:60686
2015-03-13 10:04:46,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60844 dest: /127.0.0.1:60696
2015-03-13 10:04:46,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020 src: /127.0.0.1:60845 dest: /127.0.0.1:60689
2015-03-13 10:04:46,310 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60845, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 1902000
2015-03-13 10:04:46,310 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,310 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,311 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60844, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 2403000
2015-03-13 10:04:46,311 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,311 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,311 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60843, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 3638000
2015-03-13 10:04:46,312 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,313 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741844_1020{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:04:46,314 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,315 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:04:46,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:04:46,319 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:04:46,320 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:04:46,320 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:04:46,331 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:04:46,333 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60846 dest: /127.0.0.1:60689
2015-03-13 10:04:46,334 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60847 dest: /127.0.0.1:60686
2015-03-13 10:04:46,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021 src: /127.0.0.1:60848 dest: /127.0.0.1:60696
2015-03-13 10:04:46,339 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60848, dest: /127.0.0.1:60696, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 2077000
2015-03-13 10:04:46,339 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:46,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,340 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60847, dest: /127.0.0.1:60686, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 2930000
2015-03-13 10:04:46,340 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,341 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,341 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60846, dest: /127.0.0.1:60689, bytes: 96467, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 4120000
2015-03-13 10:04:46,341 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:46,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741845_1021{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:04:46,345 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:04:46,346 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0002
2015-03-13 10:04:46,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=null
2015-03-13 10:04:46,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:46,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:46,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:46,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:46,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:46,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:46,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:46,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:46,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:46,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:46,369 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 2 submitted by user soberoi
2015-03-13 10:04:46,369 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0002
2015-03-13 10:04:46,369 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from NEW to NEW_SAVING
2015-03-13 10:04:46,369 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0002
2015-03-13 10:04:46,369 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0002
2015-03-13 10:04:46,370 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:04:46,370 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,371 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from NEW to SUBMITTED
2015-03-13 10:04:46,371 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0002 from user: soberoi activated in queue: default
2015-03-13 10:04:46,371 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0002 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:04:46,372 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0002 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:04:46,372 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0002_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:04:46,372 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0002 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:04:46,372 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:04:46,373 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from SUBMITTED to ACCEPTED
2015-03-13 10:04:46,375 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0002/
2015-03-13 10:04:46,375 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] submitted hadoop job: job_1426266260362_0002
2015-03-13 10:04:46,376 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0002/
2015-03-13 10:04:46,641 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:46,641 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:04:46,642 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:04:46,642 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0002_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:46,642 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:04:46,643 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:46,643 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:46,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0002 AttemptId: appattempt_1426266260362_0002_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:04:46,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:04:46,644 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:04:46,645 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0002_000001
2015-03-13 10:04:46,646 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,646 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0002_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:04:46,649 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:46,653 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000001 by user soberoi
2015-03-13 10:04:46,653 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:46,653 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:04:46,653 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:46,654 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000001 to application application_1426266260362_0002
2015-03-13 10:04:46,654 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:46,654 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0002_000001
2015-03-13 10:04:46,654 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:04:46,654 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:04:46,654 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:46,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:46,655 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000001
2015-03-13 10:04:46,665 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0002_01_000001.tokens. Credentials list:
2015-03-13 10:04:46,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:46,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0002_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001.tokens
2015-03-13 10:04:46,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:46,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:46,848 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60829, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 606000
2015-03-13 10:04:46,866 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:46,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:46,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:46,891 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 202000
2015-03-13 10:04:46,904 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:04:46,928 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 228000
2015-03-13 10:04:46,941 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:46,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:46,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:46,967 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60831, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1568517157_1451, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 398000
2015-03-13 10:04:46,981 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:46,981 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:46,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:47,009 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:47,009 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:47,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001/default_container_executor.sh]
2015-03-13 10:04:47,642 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:47,642 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:47,988 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:48,638 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741842_1018 to datanode(s) 127.0.0.1:60689
2015-03-13 10:04:48,638 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009]
2015-03-13 10:04:48,638 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741833_1009, blk_1073741835_1011]
2015-03-13 10:04:48,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:48,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:04:48,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED dst=null perm=null
2015-03-13 10:04:48,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:04:48,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_FAIL dst=null perm=null
2015-03-13 10:04:48,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=null
2015-03-13 10:04:48,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:04:48,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:04:48,993 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:49,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:49,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.splitmetainfo dst=null perm=null
2015-03-13 10:04:49,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60853, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020, duration: 166000
2015-03-13 10:04:49,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,254 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,255 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,256 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,256 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,257 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,258 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,259 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,259 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,275 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,276 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741834_1010
2015-03-13 10:04:49,276 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,277 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,278 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:49,278 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,278 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,306 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 to 127.0.0.1:60689
2015-03-13 10:04:49,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60856 dest: /127.0.0.1:60689
2015-03-13 10:04:49,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 src: /127.0.0.1:60856 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:04:49,319 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:04:49,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741842_1018 size 254067
2015-03-13 10:04:49,472 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017
2015-03-13 10:04:49,473 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741835_1011
2015-03-13 10:04:49,473 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,474 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:49,474 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741837_1013
2015-03-13 10:04:49,474 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,474 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741836_1012
2015-03-13 10:04:49,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:49,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:49,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:49,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:49,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:49,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,477 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:49,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:49,651 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741839_1015
2015-03-13 10:04:49,652 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014
2015-03-13 10:04:49,652 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741844_1020
2015-03-13 10:04:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:49,653 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:49,654 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:49,654 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:49,655 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:49,655 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019
2015-03-13 10:04:49,655 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:49,656 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021
2015-03-13 10:04:49,657 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741840_1016
2015-03-13 10:04:49,916 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:49,918 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0002_000001
2015-03-13 10:04:49,919 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0002 APPATTEMPTID=appattempt_1426266260362_0002_000001
2015-03-13 10:04:49,919 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:04:49,919 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from ACCEPTED to RUNNING
2015-03-13 10:04:49,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:49,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:04:49,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:04:49,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:50,121 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:04:50,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60860 dest: /127.0.0.1:60696
2015-03-13 10:04:50,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60861 dest: /127.0.0.1:60689
2015-03-13 10:04:50,164 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022 src: /127.0.0.1:60862 dest: /127.0.0.1:60693
2015-03-13 10:04:50,174 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60862, dest: /127.0.0.1:60693, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 7731000
2015-03-13 10:04:50,174 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:04:50,174 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,175 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60861, dest: /127.0.0.1:60689, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 8679000
2015-03-13 10:04:50,175 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:50,175 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60860, dest: /127.0.0.1:60696, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 9443000
2015-03-13 10:04:50,175 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,176 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:04:50,176 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741846_1022{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:04:50,180 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:04:50,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:50,998 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:51,000 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,000 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:04:51,000 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:04:51,001 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0002_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,001 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:04:51,001 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,002 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,003 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:04:51,003 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:04:51,003 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0002_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,003 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:04:51,003 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,084 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0001_01_000001 succeeded
2015-03-13 10:04:51,084 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:04:51,084 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0001_01_000001
2015-03-13 10:04:51,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0001/container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:51,094 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0001_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:04:51,094 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0001_01_000001 from application application_1426266260362_0001
2015-03-13 10:04:51,094 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:51,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0001
2015-03-13 10:04:51,164 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,164 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:04:51,165 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:04:51,165 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,165 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:04:51,165 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,166 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,166 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:04:51,166 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:04:51,167 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,167 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:04:51,167 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,168 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:04:51,168 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:04:51,168 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:04:51,168 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0002 container=Container: [ContainerId: container_1426266260362_0002_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0002_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,168 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:04:51,168 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:51,640 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741833_1009, blk_1073741835_1011]
2015-03-13 10:04:51,641 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741829_1005, blk_1073741830_1006, blk_1073741831_1007, blk_1073741832_1008, blk_1073741835_1011]
2015-03-13 10:04:51,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:51,951 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,952 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,954 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:04:51,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:51,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:51,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:51,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:51,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:51,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:51,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,002 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 1 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:04:52,002 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0001_01_000001
2015-03-13 10:04:52,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,003 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0001_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:04:52,004 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0001_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:04:52,004 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0001 CONTAINERID=container_1426266260362_0001_01_000001
2015-03-13 10:04:52,004 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0001_000001
2015-03-13 10:04:52,005 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0001_000001 State change from FINISHING to FINISHED
2015-03-13 10:04:52,006 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0001 State change from FINISHING to FINISHED
2015-03-13 10:04:52,004 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0001_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:04:52,007 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:04:52,007 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0001_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:52,007 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:04:52,007 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:04:52,007 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0001_000001 released container container_1426266260362_0001_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:04:52,008 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0001_000001 is done. finalState=FINISHED
2015-03-13 10:04:52,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,008 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0001 requests cleared
2015-03-13 10:04:52,010 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0001 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:04:52,010 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0001 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:04:52,009 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0001_000001
2015-03-13 10:04:52,009 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0001
2015-03-13 10:04:52,013 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0001,name=[3CE1BF9BD7C747EDB1F8A6829F563276/1F14FA6CB9B54C3AB9069C6E50F98834] lower*upper/(1/1) ...splatform/joininnersingle,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0001/jobhistory/job/job_1426266260362_0001,appMasterHost=Edinburgh.local,startTime=1426266268868,finishTime=1426266284940,finalStatus=SUCCEEDED
2015-03-13 10:04:52,018 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0001_000001 (auth:SIMPLE)
2015-03-13 10:04:52,021 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0001_01_000001
2015-03-13 10:04:52,104 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:52,104 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:04:52,107 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000002 by user soberoi
2015-03-13 10:04:52,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000005 by user soberoi
2015-03-13 10:04:52,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:52,109 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000004 by user soberoi
2015-03-13 10:04:52,109 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0002
2015-03-13 10:04:52,109 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:52,109 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:04:52,110 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000004 to application application_1426266260362_0002
2015-03-13 10:04:52,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000003 by user soberoi
2015-03-13 10:04:52,110 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from NEW to INITING
2015-03-13 10:04:52,111 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:04:52,109 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000002 to application application_1426266260362_0002
2015-03-13 10:04:52,111 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000003 to application application_1426266260362_0002
2015-03-13 10:04:52,109 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:04:52,112 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:52,112 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,109 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:04:52,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0002_01_000006 by user soberoi
2015-03-13 10:04:52,113 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,116 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,116 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,116 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,116 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,116 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,117 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,117 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,117 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,117 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,117 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,111 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000005 to application application_1426266260362_0002
2015-03-13 10:04:52,118 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000002
2015-03-13 10:04:52,118 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0002_01_000006 to application application_1426266260362_0002
2015-03-13 10:04:52,115 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:04:52,119 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from INITING to RUNNING
2015-03-13 10:04:52,119 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000003
2015-03-13 10:04:52,120 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:04:52,120 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,120 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,121 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,121 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,121 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,121 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,122 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0002
2015-03-13 10:04:52,122 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:04:52,123 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0002
2015-03-13 10:04:52,123 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000005
2015-03-13 10:04:52,123 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,127 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,127 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000004
2015-03-13 10:04:52,128 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,128 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,128 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0002_01_000006
2015-03-13 10:04:52,128 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar, 1426266260077, FILE, null }
2015-03-13 10:04:52,128 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:addResource(651)) - Downloading public rsrc:{ hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar, 1426266259962, FILE, null }
2015-03-13 10:04:52,139 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0002_01_000002.tokens. Credentials list:
2015-03-13 10:04:52,142 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0002_01_000003.tokens. Credentials list:
2015-03-13 10:04:52,148 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0002_01_000005.tokens. Credentials list:
2015-03-13 10:04:52,150 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0002_01_000004.tokens. Credentials list:
2015-03-13 10:04:52,151 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0002_01_000006.tokens. Credentials list:
2015-03-13 10:04:52,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:52,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:52,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:04:52,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:52,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:04:52,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:52,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:04:52,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:52,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:04:52,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:52,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:04:52,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:04:52,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:04:52,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:52,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:52,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60866, bytes: 408281, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741826_1002, duration: 1093000
2015-03-13 10:04:52,189 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60867, bytes: 485810, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741825_1001, duration: 1249000
2015-03-13 10:04:52,215 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,219 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,277 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0002_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002.tokens
2015-03-13 10:04:52,277 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0002_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005.tokens
2015-03-13 10:04:52,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:52,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:52,307 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:52,307 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741829_1005 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741829
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831 for deletion
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741833_1009 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741833
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741831_1007 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741831
2015-03-13 10:04:52,308 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741830_1006 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741830
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832 for deletion
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835 for deletion
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741832_1008 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741832
2015-03-13 10:04:52,309 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741835_1011 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741835
2015-03-13 10:04:52,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,368 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60871, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1263266516_1627, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 478000
2015-03-13 10:04:52,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar dst=null perm=null
2015-03-13 10:04:52,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60867, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-245692817_1632, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018, duration: 627000
2015-03-13 10:04:52,400 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,416 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60866, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1263266516_1627, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 313000
2015-03-13 10:04:52,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml dst=null perm=null
2015-03-13 10:04:52,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60871, bytes: 97223, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-245692817_1632, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741845_1021, duration: 389000
2015-03-13 10:04:52,454 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,454 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,454 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,469 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:04:52,469 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:04:52,513 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,513 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,514 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,514 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,521 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,521 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,522 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,522 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,523 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:04:52,523 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:04:52,663 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:52,666 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:52,666 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,667 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:52,668 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:52,669 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:52,676 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002/default_container_executor.sh]
2015-03-13 10:04:52,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005/default_container_executor.sh]
2015-03-13 10:04:52,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003/default_container_executor.sh]
2015-03-13 10:04:52,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006/default_container_executor.sh]
2015-03-13 10:04:52,693 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004/default_container_executor.sh]
2015-03-13 10:04:52,741 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:52,742 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:52,742 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:52,743 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:52,743 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:52,967 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:04:53,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,004 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:04:53,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:53,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:04:53,005 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0001
2015-03-13 10:04:53,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,005 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0001 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:04:53,005 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0001, with delay of 10800 seconds
2015-03-13 10:04:53,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,006 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0001
2015-03-13 10:04:53,169 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,169 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,169 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,489 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,501 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0002_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003.tokens
2015-03-13 10:04:53,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:53,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0002_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006.tokens
2015-03-13 10:04:53,628 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:53,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:53,737 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:04:53,876 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0002_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004.tokens
2015-03-13 10:04:53,876 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:04:54,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,174 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:54,284 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,286 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741842_1018
2015-03-13 10:04:54,484 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,661 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022
2015-03-13 10:04:54,669 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,014 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,014 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:55,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,182 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:56,699 INFO hs.JobHistory (JobHistory.java:run(188)) - History Cleaner started
2015-03-13 10:04:56,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done dst=null perm=null
2015-03-13 10:04:56,701 INFO hs.JobHistory (JobHistory.java:run(194)) - History Cleaner complete
2015-03-13 10:04:57,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:57,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,023 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:58,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:04:59,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,031 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:05:00,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:00,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:05:00,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:05:00,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60885, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 223000
2015-03-13 10:05:00,906 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60886, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 208000
2015-03-13 10:05:00,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60887, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 205000
2015-03-13 10:05:00,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:05:00,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:00,987 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60885, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 184000
2015-03-13 10:05:00,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job.split dst=null perm=null
2015-03-13 10:05:01,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,033 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:01,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:01,068 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60891, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 196000
2015-03-13 10:05:01,079 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60892, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 204000
2015-03-13 10:05:01,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60890, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 218000
2015-03-13 10:05:01,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,146 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60893, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741843_1019, duration: 216000
2015-03-13 10:05:01,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:01,253 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60894, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 216000
2015-03-13 10:05:01,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:01,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,388 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60895 dest: /127.0.0.1:60696
2015-03-13 10:05:01,437 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60896 dest: /127.0.0.1:60693
2015-03-13 10:05:01,439 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023 src: /127.0.0.1:60897 dest: /127.0.0.1:60689
2015-03-13 10:05:01,460 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60897, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 18804000
2015-03-13 10:05:01,460 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,462 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,462 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60896, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 19637000
2015-03-13 10:05:01,463 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,463 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,463 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60895, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 21998000
2015-03-13 10:05:01,463 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,464 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741847_1023{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,468 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0002_m_000003_0_24478672_1
2015-03-13 10:05:01,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0 dst=null perm=null
2015-03-13 10:05:01,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0 dst=null perm=null
2015-03-13 10:05:01,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003 dst=null perm=null
2015-03-13 10:05:01,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000003_0 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,514 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000005
2015-03-13 10:05:01,520 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,520 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,520 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000005
2015-03-13 10:05:01,521 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,521 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,521 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,531 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:01,538 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000005 is : 143
2015-03-13 10:05:01,550 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:01,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60900 dest: /127.0.0.1:60693
2015-03-13 10:05:01,552 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,553 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60901 dest: /127.0.0.1:60686
2015-03-13 10:05:01,554 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000005
2015-03-13 10:05:01,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026 src: /127.0.0.1:60902 dest: /127.0.0.1:60696
2015-03-13 10:05:01,555 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,559 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,559 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000005 from application application_1426266260362_0002
2015-03-13 10:05:01,559 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,559 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,561 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist for DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:01,582 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60898 dest: /127.0.0.1:60696
2015-03-13 10:05:01,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60903 dest: /127.0.0.1:60693
2015-03-13 10:05:01,586 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024 src: /127.0.0.1:60904 dest: /127.0.0.1:60689
2015-03-13 10:05:01,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60899 dest: /127.0.0.1:60693
2015-03-13 10:05:01,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60905 dest: /127.0.0.1:60686
2015-03-13 10:05:01,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025 src: /127.0.0.1:60906 dest: /127.0.0.1:60696
2015-03-13 10:05:01,606 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60904, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 19192000
2015-03-13 10:05:01,607 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,607 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,607 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60903, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 19380000
2015-03-13 10:05:01,608 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,608 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,608 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60898, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 20986000
2015-03-13 10:05:01,609 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,609 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741848_1024{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,619 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0002_m_000002_0_1248534415_1
2015-03-13 10:05:01,630 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60906, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 27150000
2015-03-13 10:05:01,630 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,631 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,631 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60905, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 27965000
2015-03-13 10:05:01,632 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,632 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,634 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60899, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 29826000
2015-03-13 10:05:01,634 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,635 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741849_1025{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:01,641 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0002_m_000004_0_-820717384_1
2015-03-13 10:05:01,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0 dst=null perm=null
2015-03-13 10:05:01,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0 dst=null perm=null
2015-03-13 10:05:01,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0 dst=null perm=null
2015-03-13 10:05:01,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0 dst=null perm=null
2015-03-13 10:05:01,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002 dst=null perm=null
2015-03-13 10:05:01,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004 dst=null perm=null
2015-03-13 10:05:01,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000002_0 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000004_0 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,677 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000006
2015-03-13 10:05:01,677 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:01,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:01,679 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000004
2015-03-13 10:05:01,679 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:01,679 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000006
2015-03-13 10:05:01,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000005
2015-03-13 10:05:01,680 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,681 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:01,681 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:01,681 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000005
2015-03-13 10:05:01,681 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:01,681 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:01,681 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,681 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,682 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:01,682 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:01,692 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000006 is : 143
2015-03-13 10:05:01,695 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,707 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,707 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,708 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000004
2015-03-13 10:05:01,720 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000004 is : 143
2015-03-13 10:05:01,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000006
2015-03-13 10:05:01,736 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,736 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:01,737 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000004
2015-03-13 10:05:01,740 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000006 from application application_1426266260362_0002
2015-03-13 10:05:01,741 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,741 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,741 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:01,741 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,741 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000004 from application application_1426266260362_0002
2015-03-13 10:05:01,741 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,742 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,812 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:01,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60907, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 208000
2015-03-13 10:05:01,830 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:01,871 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60908 dest: /127.0.0.1:60686
2015-03-13 10:05:01,872 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60910 dest: /127.0.0.1:60696
2015-03-13 10:05:01,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027 src: /127.0.0.1:60911 dest: /127.0.0.1:60689
2015-03-13 10:05:01,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60909 dest: /127.0.0.1:60689
2015-03-13 10:05:01,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60912 dest: /127.0.0.1:60686
2015-03-13 10:05:01,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028 src: /127.0.0.1:60913 dest: /127.0.0.1:60693
2015-03-13 10:05:01,894 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60913, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 8841000
2015-03-13 10:05:01,894 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,894 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,895 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60912, dest: /127.0.0.1:60686, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 9654000
2015-03-13 10:05:01,895 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,896 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,896 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60909, dest: /127.0.0.1:60689, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 10912000
2015-03-13 10:05:01,896 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,897 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741852_1028{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:01,899 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60911, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 23976000
2015-03-13 10:05:01,900 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:01,900 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,900 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60910, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 24750000
2015-03-13 10:05:01,901 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,901 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,901 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60908, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 25726000
2015-03-13 10:05:01,902 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:01,902 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741851_1027{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:01,909 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0002_m_000001_0_-2010036668_1
2015-03-13 10:05:01,910 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0002_m_000000_0_-505175701_1
2015-03-13 10:05:01,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0 dst=null perm=null
2015-03-13 10:05:01,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0 dst=null perm=null
2015-03-13 10:05:01,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0 dst=null perm=null
2015-03-13 10:05:01,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001 dst=null perm=null
2015-03-13 10:05:01,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000001_0 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0 dst=null perm=null
2015-03-13 10:05:01,953 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000003
2015-03-13 10:05:01,953 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,953 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,954 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000003
2015-03-13 10:05:01,954 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:01,954 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000 dst=null perm=null
2015-03-13 10:05:01,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/_temporary/attempt_1426266260362_0002_m_000000_0 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:01,967 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000003 is : 143
2015-03-13 10:05:01,980 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:01,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000003
2015-03-13 10:05:01,981 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,982 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:01,982 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000003 from application application_1426266260362_0002
2015-03-13 10:05:01,982 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:01,982 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:01,990 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000002
2015-03-13 10:05:01,990 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:01,990 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:01,990 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000002
2015-03-13 10:05:01,991 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:01,991 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:01,991 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000003
2015-03-13 10:05:01,992 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:01,992 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:01,992 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000003
2015-03-13 10:05:01,992 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:01,992 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:01,992 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,992 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:01,993 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:01,993 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000003 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:01,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:01,998 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1 dst=null perm=null
2015-03-13 10:05:02,003 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0002_01_000002 is : 143
2015-03-13 10:05:02,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000 dst=null perm=null
2015-03-13 10:05:02,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000 dst=null perm=null
2015-03-13 10:05:02,017 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:02,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000000/part-00000 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,018 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:02,018 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,019 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,019 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000002
2015-03-13 10:05:02,018 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000002 from application application_1426266260362_0002
2015-03-13 10:05:02,019 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:02,019 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:02,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001 dst=null perm=null
2015-03-13 10:05:02,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001 dst=null perm=null
2015-03-13 10:05:02,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000001/part-00001 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002 dst=null perm=null
2015-03-13 10:05:02,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002 dst=null perm=null
2015-03-13 10:05:02,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000002/part-00002 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003 dst=null perm=null
2015-03-13 10:05:02,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003 dst=null perm=null
2015-03-13 10:05:02,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000003/part-00003 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:02,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004 dst=null perm=null
2015-03-13 10:05:02,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004 dst=null perm=null
2015-03-13 10:05:02,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary/1/task_1426266260362_0002_m_000004/part-00004 dst=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_temporary dst=null perm=null
2015-03-13 10:05:02,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,061 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,067 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,084 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60902, dest: /127.0.0.1:60696, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 526956000
2015-03-13 10:05:02,084 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,085 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60901, dest: /127.0.0.1:60686, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 528256000
2015-03-13 10:05:02,085 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,087 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60900, dest: /127.0.0.1:60693, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 528916000
2015-03-13 10:05:02,087 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,087 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741850_1026{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,089 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,095 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:02,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60914 dest: /127.0.0.1:60696
2015-03-13 10:05:02,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60915 dest: /127.0.0.1:60689
2015-03-13 10:05:02,100 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029 src: /127.0.0.1:60916 dest: /127.0.0.1:60686
2015-03-13 10:05:02,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60916, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 1585000
2015-03-13 10:05:02,104 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60915, dest: /127.0.0.1:60689, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 2425000
2015-03-13 10:05:02,105 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,105 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60914, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 3290000
2015-03-13 10:05:02,106 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,106 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741853_1029{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:02,107 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist dst=null perm=null
2015-03-13 10:05:02,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:02,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist dst=null perm=null
2015-03-13 10:05:02,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:02,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1.jhist dst=null perm=null
2015-03-13 10:05:02,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,131 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60917, bytes: 53753, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026, duration: 218000
2015-03-13 10:05:02,133 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:02,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60918 dest: /127.0.0.1:60696
2015-03-13 10:05:02,136 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60919 dest: /127.0.0.1:60689
2015-03-13 10:05:02,137 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030 src: /127.0.0.1:60920 dest: /127.0.0.1:60693
2015-03-13 10:05:02,142 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60920, dest: /127.0.0.1:60693, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 3300000
2015-03-13 10:05:02,142 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,143 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60919, dest: /127.0.0.1:60689, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 4037000
2015-03-13 10:05:02,143 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,143 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,144 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60918, dest: /127.0.0.1:60696, bytes: 53333, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, duration: 4872000
2015-03-13 10:05:02,144 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741854_1030{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:02,146 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml dst=null perm=null
2015-03-13 10:05:02,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:02,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml dst=null perm=null
2015-03-13 10:05:02,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:02,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002/job_1426266260362_0002_1_conf.xml dst=null perm=null
2015-03-13 10:05:02,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:02,161 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60917, bytes: 90072, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741846_1022, duration: 350000
2015-03-13 10:05:02,163 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:02,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60921 dest: /127.0.0.1:60689
2015-03-13 10:05:02,166 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60922 dest: /127.0.0.1:60693
2015-03-13 10:05:02,168 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031 src: /127.0.0.1:60923 dest: /127.0.0.1:60696
2015-03-13 10:05:02,173 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60923, dest: /127.0.0.1:60696, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 3379000
2015-03-13 10:05:02,173 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:02,174 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60922, dest: /127.0.0.1:60693, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 4304000
2015-03-13 10:05:02,174 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,175 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60921, dest: /127.0.0.1:60689, bytes: 89372, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1214526405_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, duration: 5540000
2015-03-13 10:05:02,175 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:02,176 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,177 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,177 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741855_1031{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:02,179 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1214526405_1
2015-03-13 10:05:02,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:02,196 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:02,196 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0002
2015-03-13 10:05:02,196 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0002
2015-03-13 10:05:02,196 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from RUNNING to REMOVING
2015-03-13 10:05:02,197 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from REMOVING to FINISHING
2015-03-13 10:05:02,683 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,683 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000004
2015-03-13 10:05:02,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000006
2015-03-13 10:05:02,685 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,685 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,685 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000004
2015-03-13 10:05:02,685 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:02,685 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:02,686 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,686 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,686 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:02,686 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:02,687 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,687 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,687 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000006
2015-03-13 10:05:02,687 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:02,687 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:02,687 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,688 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,688 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:02,688 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:02,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:02,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:02,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000002
2015-03-13 10:05:02,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:02,998 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:02,998 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000002
2015-03-13 10:05:02,998 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:02,999 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:02,999 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:02,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:03,000 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:03,204 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741842_1018 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:05:03,205 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741843_1019 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:05:03,205 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741844_1020 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:05:03,205 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741845_1021 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:05:03,205 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741850_1026 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:05:03,206 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741846_1022 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:05:03,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0002 dst=null perm=null
2015-03-13 10:05:03,229 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] starting step: (1/2) ...rm/joinaroundjoinleftmost
2015-03-13 10:05:03,237 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,247 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:03,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:03,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:03,252 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 3
2015-03-13 10:05:03,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=null
2015-03-13 10:05:03,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:03,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:05:03,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,260 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,261 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60925 dest: /127.0.0.1:60686
2015-03-13 10:05:03,262 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60926 dest: /127.0.0.1:60696
2015-03-13 10:05:03,263 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60927 dest: /127.0.0.1:60689
2015-03-13 10:05:03,268 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60927, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 2775000
2015-03-13 10:05:03,268 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,268 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,268 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60926, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 2941000
2015-03-13 10:05:03,269 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,269 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,269 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60925, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 4049000
2015-03-13 10:05:03,269 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741856_1032{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,273 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,274 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar
2015-03-13 10:05:03,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:03,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:03,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:03,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:05:03,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:05:03,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:05:03,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:05:03,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:05:03,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:03,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:03,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:03,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:03,288 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:03,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,294 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split
2015-03-13 10:05:03,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,296 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:03,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60928 dest: /127.0.0.1:60693
2015-03-13 10:05:03,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60929 dest: /127.0.0.1:60689
2015-03-13 10:05:03,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60930 dest: /127.0.0.1:60686
2015-03-13 10:05:03,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033 src: /127.0.0.1:60931 dest: /127.0.0.1:60696
2015-03-13 10:05:03,304 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60931, dest: /127.0.0.1:60696, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 1608000
2015-03-13 10:05:03,305 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,305 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,305 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60930, dest: /127.0.0.1:60686, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 2183000
2015-03-13 10:05:03,306 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,306 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,306 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60929, dest: /127.0.0.1:60689, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 3065000
2015-03-13 10:05:03,306 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,307 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60928, dest: /127.0.0.1:60693, bytes: 1732, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 4152000
2015-03-13 10:05:03,307 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,308 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741857_1033{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:03,309 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,317 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60932 dest: /127.0.0.1:60696
2015-03-13 10:05:03,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60933 dest: /127.0.0.1:60693
2015-03-13 10:05:03,321 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034 src: /127.0.0.1:60934 dest: /127.0.0.1:60689
2015-03-13 10:05:03,324 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60934, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 1568000
2015-03-13 10:05:03,324 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,325 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60933, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 2061000
2015-03-13 10:05:03,325 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,325 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,325 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60932, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 2907000
2015-03-13 10:05:03,326 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,326 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741858_1034{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,328 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,328 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:03,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:03,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:03,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:03,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:03,344 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:03,346 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60935 dest: /127.0.0.1:60693
2015-03-13 10:05:03,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60936 dest: /127.0.0.1:60686
2015-03-13 10:05:03,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035 src: /127.0.0.1:60937 dest: /127.0.0.1:60689
2015-03-13 10:05:03,353 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60937, dest: /127.0.0.1:60689, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 2087000
2015-03-13 10:05:03,353 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:03,354 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,354 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60936, dest: /127.0.0.1:60686, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 2643000
2015-03-13 10:05:03,354 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,355 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60935, dest: /127.0.0.1:60693, bytes: 98867, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 3712000
2015-03-13 10:05:03,355 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:03,356 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741859_1035{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:03,359 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:03,359 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0003
2015-03-13 10:05:03,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=null
2015-03-13 10:05:03,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:03,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:03,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:03,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:03,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:03,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:03,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:03,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:03,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:03,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:03,375 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 3 submitted by user soberoi
2015-03-13 10:05:03,375 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0003
2015-03-13 10:05:03,376 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0003
2015-03-13 10:05:03,376 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0003
2015-03-13 10:05:03,376 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from NEW to NEW_SAVING
2015-03-13 10:05:03,377 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:03,377 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,377 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:03,377 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0003 from user: soberoi activated in queue: default
2015-03-13 10:05:03,377 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0003 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:03,378 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0003 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:03,378 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0003 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:03,378 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0003_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:03,378 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:03,379 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:03,380 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0003/
2015-03-13 10:05:03,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] submitted hadoop job: job_1426266260362_0003
2015-03-13 10:05:03,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper1*upper2*lower] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0003/
2015-03-13 10:05:03,658 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741856_1032 to datanode(s) 127.0.0.1:60693
2015-03-13 10:05:03,658 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022, blk_1073741850_1026]
2015-03-13 10:05:03,658 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741850_1026]
2015-03-13 10:05:03,688 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:03,689 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:03,689 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:03,689 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0003_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:03,689 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:05:03,690 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:03,690 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:03,691 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0003 AttemptId: appattempt_1426266260362_0003_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:03,691 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:03,691 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,691 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:03,692 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0003_000001
2015-03-13 10:05:03,693 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,693 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0003_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:05:03,695 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:03,698 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000001 by user soberoi
2015-03-13 10:05:03,698 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0003
2015-03-13 10:05:03,698 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:03,698 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from NEW to INITING
2015-03-13 10:05:03,698 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000001 to application application_1426266260362_0003
2015-03-13 10:05:03,699 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from INITING to RUNNING
2015-03-13 10:05:03,699 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0003_000001
2015-03-13 10:05:03,699 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:03,699 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:03,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:03,699 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:03,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:03,700 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000001
2015-03-13 10:05:03,709 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0003_01_000001.tokens. Credentials list:
2015-03-13 10:05:03,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:03,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0003_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001.tokens
2015-03-13 10:05:03,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:03,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:03,887 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60941, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 607000
2015-03-13 10:05:03,906 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:03,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:03,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:03,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:03,931 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60941, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 196000
2015-03-13 10:05:03,944 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:03,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:03,969 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60942, bytes: 1748, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 220000
2015-03-13 10:05:03,981 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:04,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:04,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:04,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:04,008 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60942, bytes: 99643, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1705763075_2037, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 322000
2015-03-13 10:05:04,021 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:04,021 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:04,046 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:04,047 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:04,114 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001/default_container_executor.sh]
2015-03-13 10:05:04,273 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,273 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,274 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026
2015-03-13 10:05:04,275 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,275 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,276 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,276 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,277 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,294 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,294 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,295 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,295 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:04,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:04,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:04,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:04,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:04,315 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:04,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:04,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:04,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:04,316 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:04,492 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,493 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741850_1026
2015-03-13 10:05:04,493 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,494 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,494 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,495 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,495 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,496 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028
2015-03-13 10:05:04,497 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:04,497 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,502 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035
2015-03-13 10:05:04,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:04,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,504 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,504 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,659 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 to 127.0.0.1:60693
2015-03-13 10:05:04,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:04,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:04,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:04,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:04,661 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:04,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60943 dest: /127.0.0.1:60693
2015-03-13 10:05:04,661 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:05:04,662 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:04,663 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032 src: /127.0.0.1:60943 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:05:04,664 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741856_1032 size 254067
2015-03-13 10:05:04,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033
2015-03-13 10:05:04,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023
2015-03-13 10:05:04,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029
2015-03-13 10:05:04,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034
2015-03-13 10:05:04,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024
2015-03-13 10:05:04,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027
2015-03-13 10:05:04,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025
2015-03-13 10:05:04,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741855_1031
2015-03-13 10:05:04,669 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:04,691 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:04,692 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:04,705 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:04,873 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741854_1030
2015-03-13 10:05:05,694 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:05,707 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:05,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:05,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED dst=null perm=null
2015-03-13 10:05:05,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:05:05,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_FAIL dst=null perm=null
2015-03-13 10:05:05,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=null
2015-03-13 10:05:05,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:05:05,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:05:06,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:06,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:06,185 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60945, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741858_1034, duration: 158000
2015-03-13 10:05:06,660 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741844_1020, blk_1073741845_1021, blk_1073741846_1022]
2015-03-13 10:05:06,661 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741842_1018, blk_1073741843_1019, blk_1073741846_1022, blk_1073741850_1026]
2015-03-13 10:05:06,697 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:06,708 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:06,971 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:06,973 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0003_000001
2015-03-13 10:05:06,973 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0003 APPATTEMPTID=appattempt_1426266260362_0003_000001
2015-03-13 10:05:06,973 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:06,973 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from ACCEPTED to RUNNING
2015-03-13 10:05:06,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:06,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:07,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:07,186 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:07,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60951 dest: /127.0.0.1:60696
2015-03-13 10:05:07,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60952 dest: /127.0.0.1:60686
2015-03-13 10:05:07,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036 src: /127.0.0.1:60953 dest: /127.0.0.1:60689
2015-03-13 10:05:07,235 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60953, dest: /127.0.0.1:60689, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 5341000
2015-03-13 10:05:07,235 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:07,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,236 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60952, dest: /127.0.0.1:60686, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 6064000
2015-03-13 10:05:07,236 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:07,237 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,237 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60951, dest: /127.0.0.1:60696, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 7033000
2015-03-13 10:05:07,237 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:07,237 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741860_1036{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:07,243 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:07,318 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844 for deletion
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845 for deletion
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741844_1020 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741844
2015-03-13 10:05:07,319 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:07,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741845_1021 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741845
2015-03-13 10:05:07,320 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842 for deletion
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843 for deletion
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846 for deletion
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741842_1018 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741842
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741843_1019 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741843
2015-03-13 10:05:07,493 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850 for deletion
2015-03-13 10:05:07,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741846_1022 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741846
2015-03-13 10:05:07,494 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741850_1026 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741850
2015-03-13 10:05:07,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:07,714 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:08,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,005 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:08,005 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:08,005 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:08,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,006 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,006 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:08,006 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:08,006 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,007 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:08,007 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,007 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,007 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:08,008 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:08,008 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,008 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:08,008 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,008 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:08,009 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:08,009 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0003_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,009 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:08,009 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,235 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0002_01_000001 succeeded
2015-03-13 10:05:08,235 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:08,235 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0002/container_1426266260362_0002_01_000001
2015-03-13 10:05:08,244 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:05:08,245 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0002_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:08,245 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0002_01_000001 from application application_1426266260362_0002
2015-03-13 10:05:08,245 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:08,245 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0002
2015-03-13 10:05:08,707 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:08,708 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:08,708 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:08,708 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:05:08,708 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0003 container=Container: [ContainerId: container_1426266260362_0003_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0003_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,709 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:08,709 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 2 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:08,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0002_01_000001
2015-03-13 10:05:08,719 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0002_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:08,720 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0002_000001
2015-03-13 10:05:08,720 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0002_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:08,720 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0002_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:08,720 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0002 CONTAINERID=container_1426266260362_0002_01_000001
2015-03-13 10:05:08,720 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0002 State change from FINISHING to FINISHED
2015-03-13 10:05:08,720 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0002_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:08,721 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0002
2015-03-13 10:05:08,721 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:08,721 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0002_000001
2015-03-13 10:05:08,721 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0002_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,722 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:08,722 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:05:08,722 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0002_000001 released container container_1426266260362_0002_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:08,722 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0002_000001 is done. finalState=FINISHED
2015-03-13 10:05:08,722 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0002 requests cleared
2015-03-13 10:05:08,723 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0002 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:05:08,723 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0002 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:05:08,721 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0002,name=[B229A65FB52F476791CA626E2F4F95DF/B348F1FAB7B345A48FA5BE9A6836732D] upper1*upper2*lower/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0002/jobhistory/job/job_1426266260362_0002,appMasterHost=Edinburgh.local,startTime=1426266286369,finishTime=1426266302197,finalStatus=SUCCEEDED
2015-03-13 10:05:08,725 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0002_000001 (auth:SIMPLE)
2015-03-13 10:05:08,727 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0002_01_000001
2015-03-13 10:05:09,005 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,006 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,007 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,007 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,008 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,008 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,007 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,009 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,009 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:09,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:09,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:09,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:09,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:09,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:09,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:09,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:09,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:09,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:09,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:09,133 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:09,133 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:09,137 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000006 by user soberoi
2015-03-13 10:05:09,137 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:09,137 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000003 by user soberoi
2015-03-13 10:05:09,137 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0003
2015-03-13 10:05:09,138 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:09,138 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000005 by user soberoi
2015-03-13 10:05:09,138 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:09,138 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000004 by user soberoi
2015-03-13 10:05:09,139 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:09,139 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000006 to application application_1426266260362_0003
2015-03-13 10:05:09,137 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0003_01_000002 by user soberoi
2015-03-13 10:05:09,139 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from NEW to INITING
2015-03-13 10:05:09,139 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,139 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000003 to application application_1426266260362_0003
2015-03-13 10:05:09,139 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000005 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000004 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0003_01_000002 to application application_1426266260362_0003
2015-03-13 10:05:09,140 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from INITING to RUNNING
2015-03-13 10:05:09,140 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,140 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,141 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,139 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,141 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,141 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,141 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,139 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:09,142 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,141 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:09,142 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,142 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,142 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,142 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:09,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:09,146 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,146 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,146 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,146 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,147 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0003
2015-03-13 10:05:09,147 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:09,148 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0003
2015-03-13 10:05:09,148 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000004
2015-03-13 10:05:09,150 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000002
2015-03-13 10:05:09,153 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000003
2015-03-13 10:05:09,154 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0003_01_000005
2015-03-13 10:05:09,172 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0003_01_000004.tokens. Credentials list:
2015-03-13 10:05:09,173 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0003_01_000003.tokens. Credentials list:
2015-03-13 10:05:09,173 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000005.tokens. Credentials list:
2015-03-13 10:05:09,174 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000002.tokens. Credentials list:
2015-03-13 10:05:09,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:09,197 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,197 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,275 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006/default_container_executor.sh]
2015-03-13 10:05:09,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0003_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003.tokens
2015-03-13 10:05:09,276 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:09,285 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:09,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:09,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:09,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar dst=null perm=null
2015-03-13 10:05:09,357 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60959, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1076734043_2174, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032, duration: 432000
2015-03-13 10:05:09,378 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:09,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:09,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:09,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml dst=null perm=null
2015-03-13 10:05:09,407 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60960, bytes: 99643, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1076734043_2174, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741859_1035, duration: 345000
2015-03-13 10:05:09,421 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:09,421 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,422 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:09,493 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,493 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,498 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,498 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,500 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,500 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741856_1032
2015-03-13 10:05:09,504 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:09,504 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:09,511 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:09,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005/default_container_executor.sh]
2015-03-13 10:05:09,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003/default_container_executor.sh]
2015-03-13 10:05:09,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004/default_container_executor.sh]
2015-03-13 10:05:09,664 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002/default_container_executor.sh]
2015-03-13 10:05:09,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:09,711 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:09,711 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:09,712 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,712 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,712 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,712 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,721 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:09,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,722 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0002
2015-03-13 10:05:09,722 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0002 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:09,722 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0002, with delay of 10800 seconds
2015-03-13 10:05:09,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0002
2015-03-13 10:05:09,877 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036
2015-03-13 10:05:10,006 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,008 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:10,027 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:05:10,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:10,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002.tokens
2015-03-13 10:05:10,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:10,688 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:10,715 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:10,809 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0003_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005.tokens
2015-03-13 10:05:10,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:10,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:11,009 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,009 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0003_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004.tokens
2015-03-13 10:05:11,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:11,718 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:11,718 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,014 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,015 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,720 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:12,720 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,723 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:13,724 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:14,734 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,031 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,032 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,738 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:15,738 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,033 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:16,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,040 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:17,229 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60970, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 233000
2015-03-13 10:05:17,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:17,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:17,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004 dst=null perm=null
2015-03-13 10:05:17,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:17,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00004 dst=null perm=null
2015-03-13 10:05:17,473 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60975, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741849_1025, duration: 164000
2015-03-13 10:05:17,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60973, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 190000
2015-03-13 10:05:17,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job.split dst=null perm=null
2015-03-13 10:05:17,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60976, bytes: 1232, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 186000
2015-03-13 10:05:17,623 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60978, bytes: 716, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 182000
2015-03-13 10:05:17,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000 dst=null perm=null
2015-03-13 10:05:17,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00000 dst=null perm=null
2015-03-13 10:05:17,640 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60973, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741852_1028, duration: 230000
2015-03-13 10:05:17,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002 dst=null perm=null
2015-03-13 10:05:17,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00002 dst=null perm=null
2015-03-13 10:05:17,704 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60979, bytes: 1748, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741857_1033, duration: 178000
2015-03-13 10:05:17,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60980, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741848_1024, duration: 201000
2015-03-13 10:05:17,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,745 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,745 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:17,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003 dst=null perm=null
2015-03-13 10:05:17,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00003 dst=null perm=null
2015-03-13 10:05:17,774 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60978, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741847_1023, duration: 190000
2015-03-13 10:05:17,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001 dst=null perm=null
2015-03-13 10:05:17,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833/part-00001 dst=null perm=null
2015-03-13 10:05:17,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60981, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741851_1027, duration: 214000
2015-03-13 10:05:17,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:17,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:17,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:17,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:17,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60982, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 178000
2015-03-13 10:05:17,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:17,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:17,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:17,975 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60983, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 2510000
2015-03-13 10:05:17,993 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0003_m_000004_0_-572601728_1
2015-03-13 10:05:18,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0 dst=null perm=null
2015-03-13 10:05:18,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0 dst=null perm=null
2015-03-13 10:05:18,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004 dst=null perm=null
2015-03-13 10:05:18,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,033 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,034 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000006
2015-03-13 10:05:18,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,042 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,047 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000006 is : 143
2015-03-13 10:05:18,048 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:18,050 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60984 dest: /127.0.0.1:60689
2015-03-13 10:05:18,051 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60985 dest: /127.0.0.1:60693
2015-03-13 10:05:18,053 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037 src: /127.0.0.1:60986 dest: /127.0.0.1:60696
2015-03-13 10:05:18,057 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist for DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,061 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000006
2015-03-13 10:05:18,062 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,062 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000006 from application application_1426266260362_0003
2015-03-13 10:05:18,063 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,063 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,178 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60987, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:05:18,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,193 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60988, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 190000
2015-03-13 10:05:18,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,219 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60989, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:05:18,220 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:18,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,233 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:60976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 172000
2015-03-13 10:05:18,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60990 dest: /127.0.0.1:60696
2015-03-13 10:05:18,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60991 dest: /127.0.0.1:60689
2015-03-13 10:05:18,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038 src: /127.0.0.1:60992 dest: /127.0.0.1:60686
2015-03-13 10:05:18,275 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60992, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 6442000
2015-03-13 10:05:18,276 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,276 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60991, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 7699000
2015-03-13 10:05:18,277 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,276 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,278 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60990, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 9507000
2015-03-13 10:05:18,278 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,278 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,279 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741862_1038{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,279 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,284 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0003_m_000000_0_1051762262_1
2015-03-13 10:05:18,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0 dst=null perm=null
2015-03-13 10:05:18,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0 dst=null perm=null
2015-03-13 10:05:18,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000 dst=null perm=null
2015-03-13 10:05:18,313 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60994, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:05:18,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60993 dest: /127.0.0.1:60693
2015-03-13 10:05:18,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60995 dest: /127.0.0.1:60696
2015-03-13 10:05:18,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039 src: /127.0.0.1:60996 dest: /127.0.0.1:60689
2015-03-13 10:05:18,332 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000002
2015-03-13 10:05:18,332 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,332 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,332 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000002
2015-03-13 10:05:18,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,346 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60996, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 14945000
2015-03-13 10:05:18,347 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,346 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000002 is : 143
2015-03-13 10:05:18,348 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60995, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 16601000
2015-03-13 10:05:18,348 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,348 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,349 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60993, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 17835000
2015-03-13 10:05:18,349 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,350 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,351 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741863_1039{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,359 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,360 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,361 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000002
2015-03-13 10:05:18,360 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,361 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,361 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000002 from application application_1426266260362_0003
2015-03-13 10:05:18,361 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,362 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,365 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 338 Total time for transactions(ms): 23 Number of transactions batched in Syncs: 0 Number of syncs: 174 SyncTimes(ms): 63 37
2015-03-13 10:05:18,366 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0003_m_000002_0_-1717617226_1
2015-03-13 10:05:18,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:60997, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:05:18,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0 dst=null perm=null
2015-03-13 10:05:18,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0 dst=null perm=null
2015-03-13 10:05:18,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002 dst=null perm=null
2015-03-13 10:05:18,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,399 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,399 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000004
2015-03-13 10:05:18,399 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,399 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000002
2015-03-13 10:05:18,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,399 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,400 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,401 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,401 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,401 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000002
2015-03-13 10:05:18,401 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:05:18,401 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:18,401 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,401 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,402 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:18,402 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000002 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:05:18,412 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000004 is : 143
2015-03-13 10:05:18,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:18,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:60979, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 190000
2015-03-13 10:05:18,427 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,427 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,428 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,430 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,431 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000004 from application application_1426266260362_0003
2015-03-13 10:05:18,431 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,431 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:18,440 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:60999, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 184000
2015-03-13 10:05:18,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:60998 dest: /127.0.0.1:60686
2015-03-13 10:05:18,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:61000 dest: /127.0.0.1:60693
2015-03-13 10:05:18,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040 src: /127.0.0.1:61001 dest: /127.0.0.1:60689
2015-03-13 10:05:18,455 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61001, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 6253000
2015-03-13 10:05:18,456 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,456 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,456 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61000, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 7304000
2015-03-13 10:05:18,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60998, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 8245000
2015-03-13 10:05:18,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741864_1040{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,463 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0003_m_000003_0_-1674850856_1
2015-03-13 10:05:18,466 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:18,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0 dst=null perm=null
2015-03-13 10:05:18,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0 dst=null perm=null
2015-03-13 10:05:18,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003 dst=null perm=null
2015-03-13 10:05:18,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,498 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000005
2015-03-13 10:05:18,498 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,498 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:18,499 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000005
2015-03-13 10:05:18,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000004
2015-03-13 10:05:18,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,500 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,500 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,500 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000004
2015-03-13 10:05:18,500 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:18,500 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:18,501 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,501 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,501 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:18,501 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000004 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:18,513 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000005 is : 143
2015-03-13 10:05:18,520 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61002 dest: /127.0.0.1:60696
2015-03-13 10:05:18,521 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61003 dest: /127.0.0.1:60689
2015-03-13 10:05:18,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041 src: /127.0.0.1:61004 dest: /127.0.0.1:60693
2015-03-13 10:05:18,528 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,529 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,529 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,530 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,531 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61004, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 7075000
2015-03-13 10:05:18,532 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,532 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,532 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61003, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 8005000
2015-03-13 10:05:18,532 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000005 from application application_1426266260362_0003
2015-03-13 10:05:18,533 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61002, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 8823000
2015-03-13 10:05:18,533 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,533 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,534 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741865_1041{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,534 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,533 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,534 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,539 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0003_m_000001_0_-1679870296_1
2015-03-13 10:05:18,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0 dst=null perm=null
2015-03-13 10:05:18,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0 dst=null perm=null
2015-03-13 10:05:18,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001 dst=null perm=null
2015-03-13 10:05:18,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/_temporary/attempt_1426266260362_0003_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:18,569 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000003
2015-03-13 10:05:18,569 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:18,569 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:18,569 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000003
2015-03-13 10:05:18,570 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:18,570 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:18,570 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000005
2015-03-13 10:05:18,571 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:18,571 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:18,571 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000005
2015-03-13 10:05:18,571 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:18,571 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:18,571 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,571 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:18,571 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:18,572 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000005 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:18,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,576 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1 dst=null perm=null
2015-03-13 10:05:18,581 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0003_01_000003 is : 143
2015-03-13 10:05:18,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000 dst=null perm=null
2015-03-13 10:05:18,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2015-03-13 10:05:18,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,595 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:18,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,596 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,596 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:18,597 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:18,597 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000003 from application application_1426266260362_0003
2015-03-13 10:05:18,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,600 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:18,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001 dst=null perm=null
2015-03-13 10:05:18,602 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:18,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2015-03-13 10:05:18,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002 dst=null perm=null
2015-03-13 10:05:18,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2015-03-13 10:05:18,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003 dst=null perm=null
2015-03-13 10:05:18,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2015-03-13 10:05:18,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:18,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004 dst=null perm=null
2015-03-13 10:05:18,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2015-03-13 10:05:18,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary/1/task_1426266260362_0003_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary dst=null perm=null
2015-03-13 10:05:18,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,641 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,646 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60986, dest: /127.0.0.1:60696, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 605647000
2015-03-13 10:05:18,660 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,661 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60985, dest: /127.0.0.1:60693, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 606779000
2015-03-13 10:05:18,662 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,662 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,663 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:60984, dest: /127.0.0.1:60689, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 608324000
2015-03-13 10:05:18,663 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,663 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741861_1037{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:18,665 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,670 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:18,672 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61005 dest: /127.0.0.1:60693
2015-03-13 10:05:18,674 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61006 dest: /127.0.0.1:60689
2015-03-13 10:05:18,675 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042 src: /127.0.0.1:61007 dest: /127.0.0.1:60686
2015-03-13 10:05:18,678 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61007, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 1220000
2015-03-13 10:05:18,678 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,678 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,678 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61006, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 1630000
2015-03-13 10:05:18,679 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,679 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,679 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61005, dest: /127.0.0.1:60693, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 2499000
2015-03-13 10:05:18,680 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,680 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741866_1042{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:18,681 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist dst=null perm=null
2015-03-13 10:05:18,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:18,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist dst=null perm=null
2015-03-13 10:05:18,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:18,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1.jhist dst=null perm=null
2015-03-13 10:05:18,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,702 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61008, bytes: 53663, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037, duration: 215000
2015-03-13 10:05:18,704 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:18,706 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61009 dest: /127.0.0.1:60696
2015-03-13 10:05:18,708 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61010 dest: /127.0.0.1:60686
2015-03-13 10:05:18,709 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043 src: /127.0.0.1:61011 dest: /127.0.0.1:60693
2015-03-13 10:05:18,713 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61011, dest: /127.0.0.1:60693, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 1976000
2015-03-13 10:05:18,713 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,713 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,714 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61010, dest: /127.0.0.1:60686, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 2658000
2015-03-13 10:05:18,714 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,714 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,714 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61009, dest: /127.0.0.1:60696, bytes: 53247, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, duration: 3498000
2015-03-13 10:05:18,715 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,715 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741867_1043{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:18,716 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml dst=null perm=null
2015-03-13 10:05:18,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:18,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml dst=null perm=null
2015-03-13 10:05:18,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:18,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003/job_1426266260362_0003_1_conf.xml dst=null perm=null
2015-03-13 10:05:18,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:18,727 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61012, bytes: 92430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741860_1036, duration: 340000
2015-03-13 10:05:18,729 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:18,731 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61013 dest: /127.0.0.1:60696
2015-03-13 10:05:18,732 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61014 dest: /127.0.0.1:60686
2015-03-13 10:05:18,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044 src: /127.0.0.1:61015 dest: /127.0.0.1:60689
2015-03-13 10:05:18,736 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61015, dest: /127.0.0.1:60689, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 1906000
2015-03-13 10:05:18,737 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:18,737 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,737 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61014, dest: /127.0.0.1:60686, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 2497000
2015-03-13 10:05:18,738 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,738 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,738 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61013, dest: /127.0.0.1:60696, bytes: 91710, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1042308078_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, duration: 3542000
2015-03-13 10:05:18,739 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:18,739 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741868_1044{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:18,740 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1042308078_1
2015-03-13 10:05:18,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:18,756 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:18,756 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0003
2015-03-13 10:05:18,756 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from RUNNING to REMOVING
2015-03-13 10:05:18,756 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0003
2015-03-13 10:05:18,756 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from REMOVING to FINISHING
2015-03-13 10:05:19,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:19,040 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:19,040 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000006
2015-03-13 10:05:19,041 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:19,041 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:19,041 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000006
2015-03-13 10:05:19,041 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:05:19,041 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:19,041 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,041 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,042 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:19,042 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:19,296 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,299 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,511 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,511 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,512 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,512 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,523 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,524 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042
2015-03-13 10:05:19,524 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,525 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,525 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,526 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040
2015-03-13 10:05:19,526 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,572 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:19,572 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000003
2015-03-13 10:05:19,573 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:19,573 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:19,573 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000003
2015-03-13 10:05:19,574 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:19,574 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:19,574 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,574 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:19,574 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:19,575 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000003 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:19,764 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741856_1032 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:05:19,764 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741857_1033 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:05:19,764 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741858_1034 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:05:19,765 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741859_1035 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:05:19,765 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741861_1037 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:05:19,765 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741860_1036 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:05:19,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0003 dst=null perm=null
2015-03-13 10:05:19,803 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741852_1028 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:05:19,803 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741851_1027 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:05:19,803 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741848_1024 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:05:19,803 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741847_1023 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:05:19,804 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741849_1025 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:05:19,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/325722705_upper1_C240FAFD34C84FFABA2C40D703528833 dst=null perm=null
2015-03-13 10:05:19,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,805 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary
2015-03-13 10:05:19,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/_temporary dst=null perm=null
2015-03-13 10:05:19,814 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,815 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:19,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:19,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:19,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2015-03-13 10:05:19,823 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 141000
2015-03-13 10:05:19,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2015-03-13 10:05:19,825 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 130000
2015-03-13 10:05:19,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2015-03-13 10:05:19,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 131000
2015-03-13 10:05:19,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2015-03-13 10:05:19,831 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 137000
2015-03-13 10:05:19,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2015-03-13 10:05:19,840 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,841 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:19,842 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:19,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,846 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:19,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2015-03-13 10:05:19,849 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 175000
2015-03-13 10:05:19,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2015-03-13 10:05:19,850 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 150000
2015-03-13 10:05:19,851 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2015-03-13 10:05:19,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 176000
2015-03-13 10:05:19,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2015-03-13 10:05:19,855 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61020, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 195000
2015-03-13 10:05:19,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2015-03-13 10:05:19,856 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost
2015-03-13 10:05:19,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost dst=null perm=null
2015-03-13 10:05:19,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2015-03-13 10:05:19,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00000 dst=null perm=null
2015-03-13 10:05:19,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038, duration: 192000
2015-03-13 10:05:19,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2015-03-13 10:05:19,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00001 dst=null perm=null
2015-03-13 10:05:19,865 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61018, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041, duration: 209000
2015-03-13 10:05:19,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2015-03-13 10:05:19,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00002 dst=null perm=null
2015-03-13 10:05:19,868 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039, duration: 175000
2015-03-13 10:05:19,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2015-03-13 10:05:19,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00003 dst=null perm=null
2015-03-13 10:05:19,870 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741864_1040, duration: 182000
2015-03-13 10:05:19,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2015-03-13 10:05:19,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinleftmost/part-00004 dst=null perm=null
2015-03-13 10:05:19,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:19,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:19,885 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:19,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741867_1043
2015-03-13 10:05:19,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741865_1041
2015-03-13 10:05:19,887 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741863_1039
2015-03-13 10:05:19,887 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:05:19,888 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:05:19,888 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741868_1044
2015-03-13 10:05:19,888 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741861_1037
2015-03-13 10:05:19,889 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741862_1038
2015-03-13 10:05:19,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:19,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] starting
2015-03-13 10:05:19,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:05:19,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:05:19,911 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes"]
2015-03-13 10:05:19,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] parallel execution is enabled: true
2015-03-13 10:05:19,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] starting jobs: 1
2015-03-13 10:05:19,912 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [tail] allocating threads: 1
2015-03-13 10:05:19,913 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] starting step: (1/1) ...ipesplatform/renamedpipes
2015-03-13 10:05:19,921 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:19,930 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:19,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:19,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:19,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:19,935 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 4
2015-03-13 10:05:19,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=null
2015-03-13 10:05:19,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:19,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:05:19,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:19,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,944 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:19,945 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61022 dest: /127.0.0.1:60689
2015-03-13 10:05:19,946 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61023 dest: /127.0.0.1:60696
2015-03-13 10:05:19,947 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61024 dest: /127.0.0.1:60693
2015-03-13 10:05:19,951 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61024, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 2822000
2015-03-13 10:05:19,952 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:19,952 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,952 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61023, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 2873000
2015-03-13 10:05:19,952 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,953 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,953 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61022, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 4334000
2015-03-13 10:05:19,953 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,954 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741869_1045{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:19,955 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:19,956 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar
2015-03-13 10:05:19,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:19,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:19,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:19,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:19,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:05:19,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:05:19,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:05:19,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:05:19,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:05:19,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:19,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:19,968 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:19,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:19,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,973 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split
2015-03-13 10:05:19,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:19,975 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:19,976 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61025 dest: /127.0.0.1:60689
2015-03-13 10:05:19,977 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61026 dest: /127.0.0.1:60693
2015-03-13 10:05:19,978 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61027 dest: /127.0.0.1:60696
2015-03-13 10:05:19,979 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046 src: /127.0.0.1:61028 dest: /127.0.0.1:60686
2015-03-13 10:05:19,982 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61028, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 1640000
2015-03-13 10:05:19,982 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:19,983 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,983 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61027, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 2043000
2015-03-13 10:05:19,983 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,983 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61026, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 2797000
2015-03-13 10:05:19,983 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,984 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,984 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,984 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61025, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 3646000
2015-03-13 10:05:19,985 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:19,988 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741870_1046{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:19,989 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:19,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:19,994 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:19,995 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61029 dest: /127.0.0.1:60693
2015-03-13 10:05:19,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61030 dest: /127.0.0.1:60696
2015-03-13 10:05:19,998 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047 src: /127.0.0.1:61031 dest: /127.0.0.1:60689
2015-03-13 10:05:20,002 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61031, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 1444000
2015-03-13 10:05:20,002 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:20,003 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,003 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61030, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 2256000
2015-03-13 10:05:20,003 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,003 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,004 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61029, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 3580000
2015-03-13 10:05:20,004 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,005 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741871_1047{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:20,006 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:20,007 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:20,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:20,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:20,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:20,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:20,013 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:20,021 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:20,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61032 dest: /127.0.0.1:60689
2015-03-13 10:05:20,024 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61033 dest: /127.0.0.1:60686
2015-03-13 10:05:20,025 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048 src: /127.0.0.1:61034 dest: /127.0.0.1:60693
2015-03-13 10:05:20,028 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61034, dest: /127.0.0.1:60693, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 1772000
2015-03-13 10:05:20,028 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:20,029 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61033, dest: /127.0.0.1:60686, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 2244000
2015-03-13 10:05:20,029 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,029 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,029 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,029 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61032, dest: /127.0.0.1:60689, bytes: 97850, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 3089000
2015-03-13 10:05:20,030 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:20,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741872_1048{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:20,032 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:20,032 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0004
2015-03-13 10:05:20,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=null
2015-03-13 10:05:20,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:20,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:20,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:20,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:20,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:20,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:20,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:20,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:20,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:20,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:20,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:20,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:20,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:20,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:20,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:20,047 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 4 submitted by user soberoi
2015-03-13 10:05:20,047 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0004
2015-03-13 10:05:20,047 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0004
2015-03-13 10:05:20,047 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0004
2015-03-13 10:05:20,047 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from NEW to NEW_SAVING
2015-03-13 10:05:20,048 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:20,048 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,048 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:20,048 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0004 from user: soberoi activated in queue: default
2015-03-13 10:05:20,049 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0004 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:20,049 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:20,049 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0004 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:20,049 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0004_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:20,049 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:20,049 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:20,052 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0004/
2015-03-13 10:05:20,052 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] submitted hadoop job: job_1426266260362_0004
2015-03-13 10:05:20,052 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [tail] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0004/
2015-03-13 10:05:20,574 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:20,574 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:20,575 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:20,575 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0004_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:20,575 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:05:20,575 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:20,575 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:20,576 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0004 AttemptId: appattempt_1426266260362_0004_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:05:20,576 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:20,577 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,577 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:20,577 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0004_000001
2015-03-13 10:05:20,578 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,578 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0004_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:05:20,581 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:20,583 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000001 by user soberoi
2015-03-13 10:05:20,583 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:20,583 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:20,584 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:20,584 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000001 to application application_1426266260362_0004
2015-03-13 10:05:20,584 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:20,584 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0004_000001
2015-03-13 10:05:20,584 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:20,584 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:20,584 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:20,585 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:20,585 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000001
2015-03-13 10:05:20,595 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0004_01_000001.tokens. Credentials list:
2015-03-13 10:05:20,610 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:20,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0004_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001.tokens
2015-03-13 10:05:20,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:20,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:20,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:20,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:20,751 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 510000
2015-03-13 10:05:20,769 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:20,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:20,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:20,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 174000
2015-03-13 10:05:20,806 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:20,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:20,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:20,830 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61017, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 177000
2015-03-13 10:05:20,843 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:20,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:20,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:20,867 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61019, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-828070478_2544, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 318000
2015-03-13 10:05:20,880 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:20,880 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:20,906 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:20,906 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:20,973 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001/default_container_executor.sh]
2015-03-13 10:05:21,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:21,574 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:21,574 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:21,669 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741869_1045 to datanode(s) 127.0.0.1:60686
2015-03-13 10:05:21,669 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741852_1028]
2015-03-13 10:05:21,669 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741859_1035, blk_1073741860_1036, blk_1073741849_1025, blk_1073741851_1027, blk_1073741852_1028]
2015-03-13 10:05:22,048 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:22,341 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:22,342 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 to 127.0.0.1:60686
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:22,343 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:22,342 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:22,343 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:22,344 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:05:22,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61038 dest: /127.0.0.1:60686
2015-03-13 10:05:22,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045 src: /127.0.0.1:61038 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:05:22,352 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741869_1045 size 254067
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:22,505 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:22,506 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:22,507 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:22,507 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:22,507 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:22,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:22,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED dst=null perm=null
2015-03-13 10:05:22,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:05:22,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_FAIL dst=null perm=null
2015-03-13 10:05:22,574 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:22,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=null
2015-03-13 10:05:22,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:05:22,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:05:22,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:22,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:22,936 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61040, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047, duration: 138000
2015-03-13 10:05:23,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:23,577 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:23,720 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:23,722 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0004_000001
2015-03-13 10:05:23,723 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0004 APPATTEMPTID=appattempt_1426266260362_0004_000001
2015-03-13 10:05:23,723 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:23,723 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from ACCEPTED to RUNNING
2015-03-13 10:05:23,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:23,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:23,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:23,938 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:23,981 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61046 dest: /127.0.0.1:60686
2015-03-13 10:05:23,983 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61047 dest: /127.0.0.1:60689
2015-03-13 10:05:23,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049 src: /127.0.0.1:61048 dest: /127.0.0.1:60693
2015-03-13 10:05:23,992 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61048, dest: /127.0.0.1:60693, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 6004000
2015-03-13 10:05:23,992 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:23,993 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,993 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61047, dest: /127.0.0.1:60689, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 6920000
2015-03-13 10:05:23,993 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:23,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,994 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61046, dest: /127.0.0.1:60686, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 7941000
2015-03-13 10:05:23,994 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:23,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741873_1049{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:23,998 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:24,054 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:24,305 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,306 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:24,306 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,512 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,583 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:24,670 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741860_1036, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741849_1025, blk_1073741851_1027]
2015-03-13 10:05:24,670 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741856_1032, blk_1073741857_1033, blk_1073741858_1034, blk_1073741859_1035, blk_1073741860_1036, blk_1073741861_1037, blk_1073741847_1023, blk_1073741848_1024, blk_1073741851_1027, blk_1073741852_1028]
2015-03-13 10:05:24,723 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:24,729 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,730 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,730 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,731 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049
2015-03-13 10:05:24,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,763 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:24,763 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:24,763 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,763 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:24,764 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,764 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,764 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:24,765 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:24,765 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,765 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:24,766 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,766 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,766 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:24,766 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:24,767 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,767 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:24,767 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,768 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:24,768 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:24,768 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0004_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,768 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:24,768 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,808 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:24,808 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:24,808 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:24,808 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0004 container=Container: [ContainerId: container_1426266260362_0004_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0004_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,808 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:24,809 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:24,892 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045
2015-03-13 10:05:24,892 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741871_1047
2015-03-13 10:05:24,893 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046
2015-03-13 10:05:24,894 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0003_01_000001 succeeded
2015-03-13 10:05:24,894 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:24,894 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0003_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:24,902 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003/container_1426266260362_0003_01_000001
2015-03-13 10:05:24,902 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0003_01_000001 from application application_1426266260362_0003
2015-03-13 10:05:24,903 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:24,903 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0003
2015-03-13 10:05:24,931 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048
2015-03-13 10:05:25,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 3 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:25,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0003_01_000001
2015-03-13 10:05:25,057 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0003_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:25,057 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0003_000001
2015-03-13 10:05:25,057 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0003_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:25,057 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0003_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:25,057 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0003 CONTAINERID=container_1426266260362_0003_01_000001
2015-03-13 10:05:25,058 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0003 State change from FINISHING to FINISHED
2015-03-13 10:05:25,058 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0003_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:25,058 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0003
2015-03-13 10:05:25,058 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:25,058 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0003,name=[B229A65FB52F476791CA626E2F4F95DF/98FC3601A29C48A6B4344FEFB9E0B80E] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0003/jobhistory/job/job_1426266260362_0003,appMasterHost=Edinburgh.local,startTime=1426266303375,finishTime=1426266318756,finalStatus=SUCCEEDED
2015-03-13 10:05:25,058 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0003_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:25,058 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0003_000001
2015-03-13 10:05:25,059 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:25,059 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:05:25,059 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0003_000001 released container container_1426266260362_0003_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:25,059 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0003_000001 is done. finalState=FINISHED
2015-03-13 10:05:25,059 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0003 requests cleared
2015-03-13 10:05:25,059 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0003 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:05:25,060 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0003 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:05:25,061 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0003_000001 (auth:SIMPLE)
2015-03-13 10:05:25,063 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0003_01_000001
2015-03-13 10:05:25,344 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:25,345 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741859_1035 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741859
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:25,346 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852 for deletion
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:25,347 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741852_1028 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741852
2015-03-13 10:05:25,586 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:25,586 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:25,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,587 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0003
2015-03-13 10:05:25,587 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:25,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,588 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:25,588 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0003, with delay of 10800 seconds
2015-03-13 10:05:25,682 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856 for deletion
2015-03-13 10:05:25,682 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857 for deletion
2015-03-13 10:05:25,682 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858 for deletion
2015-03-13 10:05:25,682 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741856_1032 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741856
2015-03-13 10:05:25,683 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741857_1033 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741857
2015-03-13 10:05:25,683 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860 for deletion
2015-03-13 10:05:25,683 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741858_1034 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741858
2015-03-13 10:05:25,683 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861 for deletion
2015-03-13 10:05:25,683 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741860_1036 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741860
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847 for deletion
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848 for deletion
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741861_1037 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741861
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849 for deletion
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851 for deletion
2015-03-13 10:05:25,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741847_1023 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741847
2015-03-13 10:05:25,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741849_1025 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741849
2015-03-13 10:05:25,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741848_1024 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741848
2015-03-13 10:05:25,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741851_1027 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741851
2015-03-13 10:05:25,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,763 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:25,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:25,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:25,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:25,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:25,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:25,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:25,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:25,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:25,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:25,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:25,887 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:25,887 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000002 by user soberoi
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000006 by user soberoi
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000004 by user soberoi
2015-03-13 10:05:25,892 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:25,892 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000005 by user soberoi
2015-03-13 10:05:25,892 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0004_01_000003 by user soberoi
2015-03-13 10:05:25,891 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:25,892 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000002 to application application_1426266260362_0004
2015-03-13 10:05:25,891 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0004
2015-03-13 10:05:25,893 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:25,892 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000004 to application application_1426266260362_0004
2015-03-13 10:05:25,893 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000005 to application application_1426266260362_0004
2015-03-13 10:05:25,893 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000003 to application application_1426266260362_0004
2015-03-13 10:05:25,894 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:25,892 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:25,894 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,895 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,895 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,895 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,895 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,896 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,896 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,896 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,896 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,896 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,896 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,892 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:25,897 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,897 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,897 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,897 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,893 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from NEW to INITING
2015-03-13 10:05:25,897 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0004_01_000006 to application application_1426266260362_0004
2015-03-13 10:05:25,897 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from INITING to RUNNING
2015-03-13 10:05:25,898 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,898 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,898 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:25,898 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0004
2015-03-13 10:05:25,898 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:25,898 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0004
2015-03-13 10:05:25,899 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,899 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:25,899 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000006
2015-03-13 10:05:25,898 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000005
2015-03-13 10:05:25,900 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000004
2015-03-13 10:05:25,901 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000002
2015-03-13 10:05:25,902 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0004_01_000003
2015-03-13 10:05:25,921 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0004_01_000004.tokens. Credentials list:
2015-03-13 10:05:25,921 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0004_01_000006.tokens. Credentials list:
2015-03-13 10:05:25,922 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000005.tokens. Credentials list:
2015-03-13 10:05:25,922 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0004_01_000002.tokens. Credentials list:
2015-03-13 10:05:25,923 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000003.tokens. Credentials list:
2015-03-13 10:05:25,939 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:25,939 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:26,017 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0004_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004.tokens
2015-03-13 10:05:26,017 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0004_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006.tokens
2015-03-13 10:05:26,017 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:26,017 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:26,057 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:26,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,058 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0003
2015-03-13 10:05:26,058 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0003 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:26,059 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0003, with delay of 10800 seconds
2015-03-13 10:05:26,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0003
2015-03-13 10:05:26,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar dst=null perm=null
2015-03-13 10:05:26,097 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61056, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_394532054_2693, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 551000
2015-03-13 10:05:26,097 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61057, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1722350459_2692, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741869_1045, duration: 567000
2015-03-13 10:05:26,119 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,119 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml dst=null perm=null
2015-03-13 10:05:26,145 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61057, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1722350459_2692, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 312000
2015-03-13 10:05:26,145 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61056, bytes: 98618, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_394532054_2693, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741872_1048, duration: 341000
2015-03-13 10:05:26,161 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,161 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,162 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,161 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:26,162 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:26,241 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,241 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,242 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,242 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,243 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,243 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,244 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,244 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,266 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:26,266 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:26,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002/default_container_executor.sh]
2015-03-13 10:05:26,393 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006/default_container_executor.sh]
2015-03-13 10:05:26,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003/default_container_executor.sh]
2015-03-13 10:05:26,412 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005/default_container_executor.sh]
2015-03-13 10:05:26,432 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004/default_container_executor.sh]
2015-03-13 10:05:26,590 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,766 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,766 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:26,779 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:05:26,815 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:26,815 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:27,197 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003.tokens
2015-03-13 10:05:27,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,435 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0004_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002.tokens
2015-03-13 10:05:27,552 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,596 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,659 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:27,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,769 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:27,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0004_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005.tokens
2015-03-13 10:05:27,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:27,816 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,600 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,773 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,773 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,774 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,774 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:28,819 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,603 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,776 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,777 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:29,820 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,604 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,782 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,783 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:30,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,610 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:31,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,615 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,790 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:32,824 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,619 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,793 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,793 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,794 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,794 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:33,830 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:34,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:34,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:34,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61069, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 204000
2015-03-13 10:05:34,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:34,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job.split dst=null perm=null
2015-03-13 10:05:34,622 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,644 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61072, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 160000
2015-03-13 10:05:34,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:34,719 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61074, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 185000
2015-03-13 10:05:34,721 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61076, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:05:34,727 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61075, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 184000
2015-03-13 10:05:34,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,758 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61077, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741870_1046, duration: 181000
2015-03-13 10:05:34,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:34,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61078, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:05:34,797 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,834 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:34,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:34,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61075, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 238000
2015-03-13 10:05:34,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:34,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:34,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:34,909 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 191000
2015-03-13 10:05:34,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:35,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,180 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61080, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 191000
2015-03-13 10:05:35,207 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:35,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61081 dest: /127.0.0.1:60689
2015-03-13 10:05:35,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61082 dest: /127.0.0.1:60693
2015-03-13 10:05:35,255 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050 src: /127.0.0.1:61083 dest: /127.0.0.1:60686
2015-03-13 10:05:35,264 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61083, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 8321000
2015-03-13 10:05:35,265 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,265 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,265 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61082, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 9227000
2015-03-13 10:05:35,266 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,266 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,267 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61081, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 10576000
2015-03-13 10:05:35,267 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,268 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741874_1050{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,272 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0004_m_000003_0_1434448342_1
2015-03-13 10:05:35,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0 dst=null perm=null
2015-03-13 10:05:35,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0 dst=null perm=null
2015-03-13 10:05:35,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003 dst=null perm=null
2015-03-13 10:05:35,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,295 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61072, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 186000
2015-03-13 10:05:35,310 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0004_m_000004_0_407531658_1
2015-03-13 10:05:35,316 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000005
2015-03-13 10:05:35,316 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,316 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,316 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000005
2015-03-13 10:05:35,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0 dst=null perm=null
2015-03-13 10:05:35,330 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000005 is : 143
2015-03-13 10:05:35,332 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:35,334 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61084 dest: /127.0.0.1:60696
2015-03-13 10:05:35,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61085 dest: /127.0.0.1:60689
2015-03-13 10:05:35,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051 src: /127.0.0.1:61086 dest: /127.0.0.1:60693
2015-03-13 10:05:35,341 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist for DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:35,343 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,343 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,344 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,344 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,346 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,346 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000005
2015-03-13 10:05:35,347 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,347 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000005 from application application_1426266260362_0004
2015-03-13 10:05:35,347 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,347 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,386 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61074, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 189000
2015-03-13 10:05:35,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,391 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61087, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 198000
2015-03-13 10:05:35,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61088, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 203000
2015-03-13 10:05:35,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:35,414 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61089, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 198000
2015-03-13 10:05:35,415 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:35,425 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:35,440 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:35,503 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61092 dest: /127.0.0.1:60686
2015-03-13 10:05:35,505 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61093 dest: /127.0.0.1:60689
2015-03-13 10:05:35,506 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054 src: /127.0.0.1:61094 dest: /127.0.0.1:60693
2015-03-13 10:05:35,509 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61091 dest: /127.0.0.1:60696
2015-03-13 10:05:35,511 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61095 dest: /127.0.0.1:60686
2015-03-13 10:05:35,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053 src: /127.0.0.1:61096 dest: /127.0.0.1:60689
2015-03-13 10:05:35,523 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61096, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 8980000
2015-03-13 10:05:35,523 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,523 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,524 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61095, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 9698000
2015-03-13 10:05:35,524 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,524 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,524 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61091, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 10616000
2015-03-13 10:05:35,525 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,525 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741877_1053{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:35,525 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61090 dest: /127.0.0.1:60696
2015-03-13 10:05:35,527 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61097 dest: /127.0.0.1:60689
2015-03-13 10:05:35,528 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052 src: /127.0.0.1:61098 dest: /127.0.0.1:60686
2015-03-13 10:05:35,540 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61098, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 9550000
2015-03-13 10:05:35,540 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,540 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,540 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61097, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 10154000
2015-03-13 10:05:35,541 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61090, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 10953000
2015-03-13 10:05:35,541 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741876_1052{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:35,567 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0004_m_000000_0_-1766763820_1
2015-03-13 10:05:35,573 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0004_m_000002_0_1723560839_1
2015-03-13 10:05:35,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0 dst=null perm=null
2015-03-13 10:05:35,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0 dst=null perm=null
2015-03-13 10:05:35,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000 dst=null perm=null
2015-03-13 10:05:35,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0 dst=null perm=null
2015-03-13 10:05:35,600 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61094, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 92305000
2015-03-13 10:05:35,600 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:35,601 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,601 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61093, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 92872000
2015-03-13 10:05:35,601 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,601 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,602 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61092, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 93725000
2015-03-13 10:05:35,602 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:35,602 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741878_1054{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:35,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0 dst=null perm=null
2015-03-13 10:05:35,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002 dst=null perm=null
2015-03-13 10:05:35,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,613 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000002
2015-03-13 10:05:35,613 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:35,613 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,613 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0004_m_000001_0_363934765_1
2015-03-13 10:05:35,613 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000002
2015-03-13 10:05:35,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:35,615 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000005
2015-03-13 10:05:35,615 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:35,615 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:35,615 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000005
2015-03-13 10:05:35,615 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:05:35,616 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:05:35,616 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:35,616 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:35,617 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:05:35,617 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000005 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:05:35,623 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0 dst=null perm=null
2015-03-13 10:05:35,628 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000002 is : 143
2015-03-13 10:05:35,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0 dst=null perm=null
2015-03-13 10:05:35,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001 dst=null perm=null
2015-03-13 10:05:35,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:35,638 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000004
2015-03-13 10:05:35,639 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:35,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:05:35,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,644 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,645 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,645 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000002
2015-03-13 10:05:35,646 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000004
2015-03-13 10:05:35,656 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000003
2015-03-13 10:05:35,656 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:35,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:35,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:35,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:35,659 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000004 is : 143
2015-03-13 10:05:35,673 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:35,674 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,674 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:35,674 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,674 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000002 from application application_1426266260362_0004
2015-03-13 10:05:35,674 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,674 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,674 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000003
2015-03-13 10:05:35,686 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000003 is : 143
2015-03-13 10:05:35,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,699 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:35,700 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:35,700 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,702 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000003
2015-03-13 10:05:35,702 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000004 from application application_1426266260362_0004
2015-03-13 10:05:35,702 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,702 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,703 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:35,703 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:35,703 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000003 from application application_1426266260362_0004
2015-03-13 10:05:35,703 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:35,703 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:35,836 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:36,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0 dst=null perm=null
2015-03-13 10:05:36,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004 dst=null perm=null
2015-03-13 10:05:36,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/_temporary/attempt_1426266260362_0004_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:36,347 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:36,349 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000006
2015-03-13 10:05:36,349 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:36,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:36,349 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000006
2015-03-13 10:05:36,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:36,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,357 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1 dst=null perm=null
2015-03-13 10:05:36,362 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0004_01_000006 is : 143
2015-03-13 10:05:36,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000 dst=null perm=null
2015-03-13 10:05:36,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2015-03-13 10:05:36,375 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:36,376 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,376 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:36,376 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000006 from application application_1426266260362_0004
2015-03-13 10:05:36,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,377 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000006
2015-03-13 10:05:36,376 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:36,377 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:36,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001 dst=null perm=null
2015-03-13 10:05:36,383 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2015-03-13 10:05:36,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002 dst=null perm=null
2015-03-13 10:05:36,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2015-03-13 10:05:36,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003 dst=null perm=null
2015-03-13 10:05:36,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2015-03-13 10:05:36,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:36,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004 dst=null perm=null
2015-03-13 10:05:36,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2015-03-13 10:05:36,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary/1/task_1426266260362_0004_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary dst=null perm=null
2015-03-13 10:05:36,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,409 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,413 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,423 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61086, dest: /127.0.0.1:60693, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1084932000
2015-03-13 10:05:36,423 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,424 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61085, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1085715000
2015-03-13 10:05:36,424 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,425 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61084, dest: /127.0.0.1:60696, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 1086984000
2015-03-13 10:05:36,426 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,426 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741875_1051{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:36,427 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,431 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:36,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61100 dest: /127.0.0.1:60693
2015-03-13 10:05:36,434 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61101 dest: /127.0.0.1:60696
2015-03-13 10:05:36,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055 src: /127.0.0.1:61102 dest: /127.0.0.1:60689
2015-03-13 10:05:36,438 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61102, dest: /127.0.0.1:60689, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 1564000
2015-03-13 10:05:36,438 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,439 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,439 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61101, dest: /127.0.0.1:60696, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 1942000
2015-03-13 10:05:36,439 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,439 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,440 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61100, dest: /127.0.0.1:60693, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 2946000
2015-03-13 10:05:36,440 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,441 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741879_1055{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,442 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist dst=null perm=null
2015-03-13 10:05:36,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:36,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist dst=null perm=null
2015-03-13 10:05:36,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:05:36,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1.jhist dst=null perm=null
2015-03-13 10:05:36,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61103, bytes: 53737, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051, duration: 219000
2015-03-13 10:05:36,465 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:36,466 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61104 dest: /127.0.0.1:60696
2015-03-13 10:05:36,468 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61105 dest: /127.0.0.1:60686
2015-03-13 10:05:36,469 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056 src: /127.0.0.1:61106 dest: /127.0.0.1:60689
2015-03-13 10:05:36,471 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61106, dest: /127.0.0.1:60689, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 1633000
2015-03-13 10:05:36,471 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,472 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,472 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61105, dest: /127.0.0.1:60686, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 2135000
2015-03-13 10:05:36,472 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,472 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,473 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61104, dest: /127.0.0.1:60696, bytes: 53317, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, duration: 2939000
2015-03-13 10:05:36,473 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,473 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741880_1056{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:36,475 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml dst=null perm=null
2015-03-13 10:05:36,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:36,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml dst=null perm=null
2015-03-13 10:05:36,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp dst=null perm=null
2015-03-13 10:05:36,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004/job_1426266260362_0004_1_conf.xml dst=null perm=null
2015-03-13 10:05:36,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:36,484 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61107, bytes: 91377, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741873_1049, duration: 317000
2015-03-13 10:05:36,485 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:36,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61108 dest: /127.0.0.1:60696
2015-03-13 10:05:36,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61109 dest: /127.0.0.1:60689
2015-03-13 10:05:36,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057 src: /127.0.0.1:61110 dest: /127.0.0.1:60686
2015-03-13 10:05:36,492 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61110, dest: /127.0.0.1:60686, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 1856000
2015-03-13 10:05:36,493 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:36,493 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,493 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61109, dest: /127.0.0.1:60689, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 2332000
2015-03-13 10:05:36,493 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,494 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,494 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61108, dest: /127.0.0.1:60696, bytes: 90665, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1084064864_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, duration: 3330000
2015-03-13 10:05:36,494 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:36,495 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741881_1057{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:36,496 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1084064864_1
2015-03-13 10:05:36,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:05:36,512 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from RUNNING to FINISHING
2015-03-13 10:05:36,512 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0004
2015-03-13 10:05:36,512 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from RUNNING to REMOVING
2015-03-13 10:05:36,512 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0004
2015-03-13 10:05:36,512 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from REMOVING to FINISHING
2015-03-13 10:05:36,629 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:36,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000002
2015-03-13 10:05:36,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000003
2015-03-13 10:05:36,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:36,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000004
2015-03-13 10:05:36,660 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,660 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,660 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000002
2015-03-13 10:05:36,660 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:36,660 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:05:36,661 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,661 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,661 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:05:36,661 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:36,661 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,662 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,662 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000003
2015-03-13 10:05:36,662 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:36,662 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:05:36,662 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,663 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,663 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:05:36,663 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:36,663 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:36,663 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:36,663 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000004
2015-03-13 10:05:36,663 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:36,663 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:05:36,664 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,664 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:36,664 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:05:36,664 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000004 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:37,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:37,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000006
2015-03-13 10:05:37,355 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:37,355 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:37,355 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000006
2015-03-13 10:05:37,355 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:37,356 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:05:37,356 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:37,357 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:37,357 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:05:37,357 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741869_1045 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741870_1046 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741871_1047 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741872_1048 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741875_1051 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:05:37,520 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741873_1049 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:05:37,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0004 dst=null perm=null
2015-03-13 10:05:37,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,558 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary
2015-03-13 10:05:37,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/_temporary dst=null perm=null
2015-03-13 10:05:37,566 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,567 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,568 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,572 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:37,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2015-03-13 10:05:37,575 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 157000
2015-03-13 10:05:37,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2015-03-13 10:05:37,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 140000
2015-03-13 10:05:37,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2015-03-13 10:05:37,582 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 154000
2015-03-13 10:05:37,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2015-03-13 10:05:37,584 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 120000
2015-03-13 10:05:37,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2015-03-13 10:05:37,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,595 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,596 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,601 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:05:37,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2015-03-13 10:05:37,605 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 200000
2015-03-13 10:05:37,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2015-03-13 10:05:37,608 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 180000
2015-03-13 10:05:37,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2015-03-13 10:05:37,611 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 185000
2015-03-13 10:05:37,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2015-03-13 10:05:37,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 181000
2015-03-13 10:05:37,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2015-03-13 10:05:37,614 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/renamedpipes
2015-03-13 10:05:37,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes dst=null perm=null
2015-03-13 10:05:37,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2015-03-13 10:05:37,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00000 dst=null perm=null
2015-03-13 10:05:37,622 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052, duration: 202000
2015-03-13 10:05:37,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2015-03-13 10:05:37,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00001 dst=null perm=null
2015-03-13 10:05:37,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054, duration: 164000
2015-03-13 10:05:37,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2015-03-13 10:05:37,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00002 dst=null perm=null
2015-03-13 10:05:37,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053, duration: 225000
2015-03-13 10:05:37,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2015-03-13 10:05:37,630 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:37,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00003 dst=null perm=null
2015-03-13 10:05:37,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050, duration: 160000
2015-03-13 10:05:37,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2015-03-13 10:05:37,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/renamedpipes/part-00004 dst=null perm=null
2015-03-13 10:05:37,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:37,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:37,654 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,664 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:05:37,664 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:05:37,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:05:37,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:05:37,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:05:37,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:05:37,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery"]
2015-03-13 10:05:37,711 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:05:37,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 3
2015-03-13 10:05:37,712 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 3
2015-03-13 10:05:37,713 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/3)
2015-03-13 10:05:37,713 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/3)
2015-03-13 10:05:37,721 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,729 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,737 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:05:37,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:37,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:37,743 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 5
2015-03-13 10:05:37,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=null
2015-03-13 10:05:37,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:37,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:05:37,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:37,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,749 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:05:37,751 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:37,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:37,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61116 dest: /127.0.0.1:60689
2015-03-13 10:05:37,753 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 6
2015-03-13 10:05:37,754 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61117 dest: /127.0.0.1:60693
2015-03-13 10:05:37,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=null
2015-03-13 10:05:37,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61118 dest: /127.0.0.1:60686
2015-03-13 10:05:37,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:05:37,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:05:37,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:37,759 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61118, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 2301000
2015-03-13 10:05:37,759 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,760 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,760 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61117, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 2712000
2015-03-13 10:05:37,760 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,761 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,761 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61116, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 3995000
2015-03-13 10:05:37,761 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741882_1058{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,764 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,764 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,765 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar
2015-03-13 10:05:37,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:37,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61119 dest: /127.0.0.1:60689
2015-03-13 10:05:37,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61120 dest: /127.0.0.1:60696
2015-03-13 10:05:37,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61121 dest: /127.0.0.1:60693
2015-03-13 10:05:37,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:05:37,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:05:37,772 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61121, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 2067000
2015-03-13 10:05:37,772 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:05:37,773 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,773 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61120, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 3099000
2015-03-13 10:05:37,773 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,774 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:05:37,774 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61119, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 3977000
2015-03-13 10:05:37,774 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,775 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741883_1059{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:05:37,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,777 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,777 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar
2015-03-13 10:05:37,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:37,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:37,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,779 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:37,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:37,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:05:37,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:05:37,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:05:37,783 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split
2015-03-13 10:05:37,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:05:37,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:37,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:05:37,784 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61122 dest: /127.0.0.1:60686
2015-03-13 10:05:37,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:37,786 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:05:37,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61123 dest: /127.0.0.1:60689
2015-03-13 10:05:37,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:05:37,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61124 dest: /127.0.0.1:60696
2015-03-13 10:05:37,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,789 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060 src: /127.0.0.1:61125 dest: /127.0.0.1:60693
2015-03-13 10:05:37,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,792 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split
2015-03-13 10:05:37,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:37,793 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61125, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 1576000
2015-03-13 10:05:37,793 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,794 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61124, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 2694000
2015-03-13 10:05:37,794 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,794 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,794 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,794 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61123, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 3345000
2015-03-13 10:05:37,795 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,796 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61122, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 3945000
2015-03-13 10:05:37,796 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,796 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741884_1060{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,797 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61126 dest: /127.0.0.1:60689
2015-03-13 10:05:37,799 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61127 dest: /127.0.0.1:60696
2015-03-13 10:05:37,799 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,800 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61128 dest: /127.0.0.1:60693
2015-03-13 10:05:37,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,801 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061 src: /127.0.0.1:61129 dest: /127.0.0.1:60686
2015-03-13 10:05:37,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,804 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61129, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 1839000
2015-03-13 10:05:37,805 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:37,805 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,805 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,805 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61128, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 2291000
2015-03-13 10:05:37,805 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,806 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61127, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 3213000
2015-03-13 10:05:37,806 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,806 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61130 dest: /127.0.0.1:60696
2015-03-13 10:05:37,807 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,807 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61126, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 3938000
2015-03-13 10:05:37,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741885_1061{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,808 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,809 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61131 dest: /127.0.0.1:60693
2015-03-13 10:05:37,811 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062 src: /127.0.0.1:61132 dest: /127.0.0.1:60686
2015-03-13 10:05:37,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,814 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61132, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 1541000
2015-03-13 10:05:37,814 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,814 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,815 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61131, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 1901000
2015-03-13 10:05:37,815 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,815 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,815 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61130, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 2863000
2015-03-13 10:05:37,816 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741886_1062{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:37,817 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:05:37,818 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,818 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:37,818 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61133 dest: /127.0.0.1:60689
2015-03-13 10:05:37,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,820 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61134 dest: /127.0.0.1:60693
2015-03-13 10:05:37,821 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063 src: /127.0.0.1:61135 dest: /127.0.0.1:60696
2015-03-13 10:05:37,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,823 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:05:37,823 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61135, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 1050000
2015-03-13 10:05:37,824 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,824 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,824 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:05:37,824 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61134, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 1646000
2015-03-13 10:05:37,825 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,825 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.value.class is deprecated. Instead, use mapreduce.map.output.value.class
2015-03-13 10:05:37,825 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61133, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 2384000
2015-03-13 10:05:37,825 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,825 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,826 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741887_1063{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:05:37,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:05:37,827 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.mapoutput.key.class is deprecated. Instead, use mapreduce.map.output.key.class
2015-03-13 10:05:37,827 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,828 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:05:37,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:05:37,865 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61136 dest: /127.0.0.1:60686
2015-03-13 10:05:37,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61137 dest: /127.0.0.1:60689
2015-03-13 10:05:37,869 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064 src: /127.0.0.1:61138 dest: /127.0.0.1:60693
2015-03-13 10:05:37,876 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:05:37,876 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61138, dest: /127.0.0.1:60693, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 5358000
2015-03-13 10:05:37,876 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,877 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,877 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61137, dest: /127.0.0.1:60689, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 5900000
2015-03-13 10:05:37,877 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61139 dest: /127.0.0.1:60686
2015-03-13 10:05:37,878 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61136, dest: /127.0.0.1:60686, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 7100000
2015-03-13 10:05:37,878 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,878 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741888_1064{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,880 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61140 dest: /127.0.0.1:60689
2015-03-13 10:05:37,881 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,881 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0005
2015-03-13 10:05:37,882 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065 src: /127.0.0.1:61141 dest: /127.0.0.1:60693
2015-03-13 10:05:37,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=null
2015-03-13 10:05:37,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:37,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:37,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:37,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:37,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:37,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:37,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:37,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:37,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,896 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 5 submitted by user soberoi
2015-03-13 10:05:37,896 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0005
2015-03-13 10:05:37,896 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0005
2015-03-13 10:05:37,897 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0005
2015-03-13 10:05:37,897 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from NEW to NEW_SAVING
2015-03-13 10:05:37,897 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:37,897 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0005_000001
2015-03-13 10:05:37,897 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:37,898 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0005 from user: soberoi activated in queue: default
2015-03-13 10:05:37,898 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0005 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:37,898 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0005 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:37,898 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0005 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,898 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0005_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:05:37,898 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:37,900 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:37,902 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0005/
2015-03-13 10:05:37,902 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0005
2015-03-13 10:05:37,902 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0005/
2015-03-13 10:05:37,902 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61141, dest: /127.0.0.1:60693, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 19339000
2015-03-13 10:05:37,903 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:37,903 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,903 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61140, dest: /127.0.0.1:60689, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 19328000
2015-03-13 10:05:37,903 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,904 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,904 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61139, dest: /127.0.0.1:60686, bytes: 97970, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 20068000
2015-03-13 10:05:37,904 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:37,905 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741889_1065{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:05:37,907 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:05:37,907 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0006
2015-03-13 10:05:37,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=null
2015-03-13 10:05:37,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:37,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:37,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:37,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:37,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:37,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:37,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:37,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:37,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:37,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:37,924 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 6 submitted by user soberoi
2015-03-13 10:05:37,924 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0006
2015-03-13 10:05:37,925 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0006
2015-03-13 10:05:37,925 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0006
2015-03-13 10:05:37,925 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from NEW to NEW_SAVING
2015-03-13 10:05:37,925 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:05:37,925 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0006_000001
2015-03-13 10:05:37,925 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from NEW to SUBMITTED
2015-03-13 10:05:37,926 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0006 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 1 #user-active-applications: 2 #queue-pending-applications: 1 #queue-active-applications: 2
2015-03-13 10:05:37,926 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0006 user: soberoi leaf-queue of parent: root #applications: 3
2015-03-13 10:05:37,926 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0006_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=3, numContainers=1, currently active: 3
2015-03-13 10:05:37,926 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0006 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:05:37,926 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:05:37,926 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from SUBMITTED to ACCEPTED
2015-03-13 10:05:37,928 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0006/
2015-03-13 10:05:37,929 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0006
2015-03-13 10:05:37,929 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0006/
2015-03-13 10:05:38,099 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:38,099 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:05:38,099 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:05:38,100 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0005_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=3, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:38,100 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=3, numContainers=2
2015-03-13 10:05:38,100 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:38,100 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:38,101 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0005 AttemptId: appattempt_1426266260362_0005_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:38,101 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:38,101 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,102 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:38,102 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0005_000001
2015-03-13 10:05:38,103 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,103 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0005_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:05:38,106 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:38,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000001 by user soberoi
2015-03-13 10:05:38,108 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:38,108 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:05:38,108 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:38,109 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000001 to application application_1426266260362_0005
2015-03-13 10:05:38,109 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:38,109 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0005_000001
2015-03-13 10:05:38,109 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:38,109 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:05:38,109 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:38,109 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:38,110 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000001
2015-03-13 10:05:38,120 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0005_01_000001.tokens. Credentials list:
2015-03-13 10:05:38,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:38,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0005_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001.tokens
2015-03-13 10:05:38,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:38,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:38,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:38,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:38,279 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61112, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 544000
2015-03-13 10:05:38,299 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:38,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:38,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:38,323 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 180000
2015-03-13 10:05:38,335 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:38,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:38,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:38,359 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61114, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 174000
2015-03-13 10:05:38,371 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:38,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:38,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:38,395 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61113, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-44404711_3130, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 304000
2015-03-13 10:05:38,409 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:38,409 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:38,434 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:38,434 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:38,503 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001/default_container_executor.sh]
2015-03-13 10:05:38,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,104 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:39,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:39,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:39,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,636 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:39,678 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741882_1058 to datanode(s) 127.0.0.1:60696
2015-03-13 10:05:39,679 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741883_1059 to datanode(s) 127.0.0.1:60686
2015-03-13 10:05:39,679 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741869_1045, blk_1073741870_1046]
2015-03-13 10:05:39,679 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:39,724 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:39,725 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:39,725 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,726 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,737 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,738 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:39,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:39,903 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,903 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,904 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:39,904 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:39,904 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:39,905 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,905 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:39,905 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,906 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:39,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:39,924 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:39,942 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:39,942 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,943 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:39,943 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,946 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061
2015-03-13 10:05:39,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741881_1057
2015-03-13 10:05:39,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741877_1053
2015-03-13 10:05:39,948 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:39,948 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741878_1054
2015-03-13 10:05:39,948 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741874_1050
2015-03-13 10:05:39,950 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:40,108 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:40,109 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,109 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062
2015-03-13 10:05:40,142 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060
2015-03-13 10:05:40,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:40,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:40,150 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:40,151 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063
2015-03-13 10:05:40,151 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741876_1052
2015-03-13 10:05:40,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:40,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED dst=null perm=null
2015-03-13 10:05:40,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:05:40,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_FAIL dst=null perm=null
2015-03-13 10:05:40,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=null
2015-03-13 10:05:40,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:05:40,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:05:40,341 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:40,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064
2015-03-13 10:05:40,354 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 to 127.0.0.1:60686
2015-03-13 10:05:40,354 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741875_1051
2015-03-13 10:05:40,355 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:40,355 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741880_1056
2015-03-13 10:05:40,355 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:40,355 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:40,355 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:40,355 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055
2015-03-13 10:05:40,356 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:40,356 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:40,356 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:40,356 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:40,356 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:05:40,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61146 dest: /127.0.0.1:60686
2015-03-13 10:05:40,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059 src: /127.0.0.1:61146 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:05:40,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741883_1059 size 254067
2015-03-13 10:05:40,518 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 to 127.0.0.1:60696
2015-03-13 10:05:40,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:40,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:40,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:40,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:40,519 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:40,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:40,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:40,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:40,520 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:05:40,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:40,520 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61147 dest: /127.0.0.1:60696
2015-03-13 10:05:40,520 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:40,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:40,521 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:40,522 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058 src: /127.0.0.1:61147 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:05:40,523 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741882_1058 size 254067
2015-03-13 10:05:40,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:40,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:40,550 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065
2015-03-13 10:05:40,605 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61148, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741886_1062, duration: 151000
2015-03-13 10:05:40,642 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,110 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,420 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:41,423 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0005_000001
2015-03-13 10:05:41,423 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0005 APPATTEMPTID=appattempt_1426266260362_0005_000001
2015-03-13 10:05:41,423 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:41,423 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from ACCEPTED to RUNNING
2015-03-13 10:05:41,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:41,445 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:41,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:41,637 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:05:41,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:41,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61154 dest: /127.0.0.1:60689
2015-03-13 10:05:41,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61155 dest: /127.0.0.1:60693
2015-03-13 10:05:41,683 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066 src: /127.0.0.1:61156 dest: /127.0.0.1:60686
2015-03-13 10:05:41,690 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61156, dest: /127.0.0.1:60686, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 5507000
2015-03-13 10:05:41,690 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:41,690 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61155, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 6230000
2015-03-13 10:05:41,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:41,691 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61154, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 7284000
2015-03-13 10:05:41,692 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:41,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741890_1066{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:05:41,696 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:05:42,116 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:42,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:42,649 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,649 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:42,649 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:05:42,650 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=3, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,650 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=3, numContainers=3
2015-03-13 10:05:42,650 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,650 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,650 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:42,651 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:05:42,651 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=3, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,651 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=3, numContainers=4
2015-03-13 10:05:42,651 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,661 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0004_01_000001 succeeded
2015-03-13 10:05:42,661 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:05:42,661 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0004_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:05:42,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0004/container_1426266260362_0004_01_000001
2015-03-13 10:05:42,669 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0004_01_000001 from application application_1426266260362_0004
2015-03-13 10:05:42,670 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:42,670 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0004
2015-03-13 10:05:42,674 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,675 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:42,675 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:42,675 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=3, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,675 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=5
2015-03-13 10:05:42,675 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,675 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,676 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:42,676 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:42,676 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,676 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=3, numContainers=6
2015-03-13 10:05:42,676 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,676 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:42,677 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:42,677 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:42,677 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0005_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=3, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,677 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=3, numContainers=7
2015-03-13 10:05:42,677 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:42,685 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741872_1048, blk_1073741873_1049, blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:42,685 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741875_1051, blk_1073741869_1045, blk_1073741870_1046, blk_1073741871_1047]
2015-03-13 10:05:43,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,360 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872 for deletion
2015-03-13 10:05:43,360 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873 for deletion
2015-03-13 10:05:43,361 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:43,361 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741872_1048 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741872
2015-03-13 10:05:43,361 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:43,361 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:43,361 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741873_1049 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741873
2015-03-13 10:05:43,362 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:43,362 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:43,362 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:43,363 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:43,363 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:43,459 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,460 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:43,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:43,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:43,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:43,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:43,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:43,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:43,584 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:43,584 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:43,587 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000002 by user soberoi
2015-03-13 10:05:43,587 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000005 by user soberoi
2015-03-13 10:05:43,588 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:43,588 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:43,588 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000006 by user soberoi
2015-03-13 10:05:43,587 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0005
2015-03-13 10:05:43,588 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:43,588 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:43,587 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000003 by user soberoi
2015-03-13 10:05:43,589 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:43,589 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:43,588 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from NEW to INITING
2015-03-13 10:05:43,589 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000005 to application application_1426266260362_0005
2015-03-13 10:05:43,589 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000006 to application application_1426266260362_0005
2015-03-13 10:05:43,589 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:43,590 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,590 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,590 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,590 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,590 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,590 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,588 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000004 by user soberoi
2015-03-13 10:05:43,591 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:43,590 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,591 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,591 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,592 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,592 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,592 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,589 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000002 to application application_1426266260362_0005
2015-03-13 10:05:43,592 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000003 to application application_1426266260362_0005
2015-03-13 10:05:43,592 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from INITING to RUNNING
2015-03-13 10:05:43,592 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000006
2015-03-13 10:05:43,593 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,593 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,593 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,593 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,594 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,594 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,594 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,594 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000004 to application application_1426266260362_0005
2015-03-13 10:05:43,594 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000005
2015-03-13 10:05:43,594 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:43,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,595 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,595 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,595 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,595 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000002
2015-03-13 10:05:43,596 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:43,596 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,596 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:43,596 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:43,596 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:43,597 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000004
2015-03-13 10:05:43,598 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0005_01_000003
2015-03-13 10:05:43,620 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0005_01_000006.tokens. Credentials list:
2015-03-13 10:05:43,624 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000005.tokens. Credentials list:
2015-03-13 10:05:43,626 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000004.tokens. Credentials list:
2015-03-13 10:05:43,627 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000003.tokens. Credentials list:
2015-03-13 10:05:43,628 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000002.tokens. Credentials list:
2015-03-13 10:05:43,642 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:43,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:43,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 4 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:05:43,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0004_01_000001
2015-03-13 10:05:43,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,652 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0004_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:43,652 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0004_000001
2015-03-13 10:05:43,652 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0004_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:05:43,653 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0004_000001 State change from FINISHING to FINISHED
2015-03-13 10:05:43,653 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0004 State change from FINISHING to FINISHED
2015-03-13 10:05:43,653 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0004 CONTAINERID=container_1426266260362_0004_01_000001
2015-03-13 10:05:43,653 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0004_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:43,653 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:05:43,653 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0004
2015-03-13 10:05:43,653 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0004_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,653 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0004_000001
2015-03-13 10:05:43,653 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,654 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=3, numContainers=6
2015-03-13 10:05:43,654 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0004_000001 released container container_1426266260362_0004_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:43,654 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0004_000001 is done. finalState=FINISHED
2015-03-13 10:05:43,653 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0004,name=[DF98BEF6B79549DA8449852A7CBDC6EB/5EF25D47FD21419386DBBAEE8B2D20AA] tail/(1/1) ...ipesplatform/renamedpipes,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0004/jobhistory/job/job_1426266260362_0004,appMasterHost=Edinburgh.local,startTime=1426266320047,finishTime=1426266336512,finalStatus=SUCCEEDED
2015-03-13 10:05:43,654 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0004 requests cleared
2015-03-13 10:05:43,654 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0006 from user: soberoi activated in queue: default
2015-03-13 10:05:43,655 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0004 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:05:43,655 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0004 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:05:43,657 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0004_000001 (auth:SIMPLE)
2015-03-13 10:05:43,659 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0004_01_000001
2015-03-13 10:05:43,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:43,676 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:43,676 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:43,676 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:43,676 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,676 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:43,677 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:43,677 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:43,677 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000001 Container Transitioned from NEW to RESERVED
2015-03-13 10:05:43,678 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:43,678 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(237)) - Reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:43,678 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,678 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:43,678 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:43,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875 for deletion
2015-03-13 10:05:43,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869 for deletion
2015-03-13 10:05:43,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870 for deletion
2015-03-13 10:05:43,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871 for deletion
2015-03-13 10:05:43,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741875_1051 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741875
2015-03-13 10:05:43,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741869_1045 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741869
2015-03-13 10:05:43,698 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741871_1047 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741871
2015-03-13 10:05:43,699 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741870_1046 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741870
2015-03-13 10:05:43,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0005_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006.tokens
2015-03-13 10:05:43,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:43,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003.tokens
2015-03-13 10:05:43,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:43,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar dst=null perm=null
2015-03-13 10:05:43,806 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61164, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-922574451_3278, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 606000
2015-03-13 10:05:43,812 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61165, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-853821759_3281, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058, duration: 588000
2015-03-13 10:05:43,829 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,832 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml dst=null perm=null
2015-03-13 10:05:43,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61166, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-922574451_3278, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 244000
2015-03-13 10:05:43,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61165, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-853821759_3281, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741888_1064, duration: 379000
2015-03-13 10:05:43,872 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,872 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,872 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,872 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,878 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:43,878 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,878 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:43,922 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,922 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,929 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,930 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:43,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:43,931 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:44,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005/default_container_executor.sh]
2015-03-13 10:05:44,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003/default_container_executor.sh]
2015-03-13 10:05:44,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004/default_container_executor.sh]
2015-03-13 10:05:44,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002/default_container_executor.sh]
2015-03-13 10:05:44,088 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006/default_container_executor.sh]
2015-03-13 10:05:44,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,375 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:44,375 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,375 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:44,376 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:44,376 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:44,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,377 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,377 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,478 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:05:44,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,656 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:05:44,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0004
2015-03-13 10:05:44,657 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0004
2015-03-13 10:05:44,658 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0004 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:05:44,658 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0004, with delay of 10800 seconds
2015-03-13 10:05:44,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,680 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:44,680 INFO capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:44,680 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:44,680 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(233)) - Updated reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:44,681 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:44,681 INFO capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(692)) - Skipping scheduling since node 10.1.1.144:60715 is reserved by application appattempt_1426266260362_0006_000001
2015-03-13 10:05:44,901 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:44,907 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:44,928 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004.tokens
2015-03-13 10:05:45,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0005_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002.tokens
2015-03-13 10:05:45,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,123 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,134 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059
2015-03-13 10:05:45,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:45,314 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741882_1058
2015-03-13 10:05:45,319 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0005_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005.tokens
2015-03-13 10:05:45,320 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:05:45,345 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,553 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066
2015-03-13 10:05:45,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,662 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:45,681 INFO capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:45,682 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:reserve(432)) - Application application_1426266260362_0006 reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 1 at priority 0; currentReservation 2048
2015-03-13 10:05:45,682 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:reserveResource(233)) - Updated reserved container container_1426266260362_0006_01_000001 on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 for application org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica.FiCaSchedulerApp@3b48284e
2015-03-13 10:05:45,682 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1381)) - Reserved container application=application_1426266260362_0006 resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:45,682 INFO capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(692)) - Skipping scheduling since node 10.1.1.144:60715 is reserved by application appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,124 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,125 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:46,125 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:05:46,125 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000002 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:05:46,126 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0006_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,126 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:11264, vCores:8>usedCapacity=0.6875, absoluteUsedCapacity=0.6875, numApps=2, numContainers=8
2015-03-13 10:05:46,126 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:46,126 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.6875 absoluteUsedCapacity=0.6875 used=<memory:11264, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,127 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0006 AttemptId: appattempt_1426266260362_0006_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:05:46,127 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:05:46,127 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,127 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:05:46,128 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0006_000001
2015-03-13 10:05:46,129 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,129 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0006_01_000002 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:05:46,132 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:46,134 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000002 by user soberoi
2015-03-13 10:05:46,134 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:46,135 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:05:46,135 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:46,135 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000002 to application application_1426266260362_0006
2015-03-13 10:05:46,135 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0006_000001
2015-03-13 10:05:46,135 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:46,135 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:05:46,136 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:05:46,136 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:46,136 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:46,136 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000002
2015-03-13 10:05:46,152 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0006_01_000002.tokens. Credentials list:
2015-03-13 10:05:46,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:46,303 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0006_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002.tokens
2015-03-13 10:05:46,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:46,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:46,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:46,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:46,426 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 491000
2015-03-13 10:05:46,456 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:46,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:46,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:46,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61174, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 176000
2015-03-13 10:05:46,521 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:46,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:46,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:05:46,566 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 165000
2015-03-13 10:05:46,589 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:46,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:46,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:46,635 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61173, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1084292462_3561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 296000
2015-03-13 10:05:46,662 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:46,662 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:46,666 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,666 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:46,685 INFO capacity.CapacityScheduler (CapacityScheduler.java:nodeUpdate(668)) - Trying to fulfill reservation for application application_1426266260362_0006 on node: 10.1.1.144:60715
2015-03-13 10:05:46,685 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:unreserve(463)) - Application application_1426266260362_0006 unreserved on node host: 10.1.1.144:60715 #containers=3 available=1024 used=3072, currently has 0 at priority 0; currentReservation <memory:0, vCores:0>
2015-03-13 10:05:46,686 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:9216, vCores:7> numContainers=7 user=soberoi user-resources=<memory:9216, vCores:7>
2015-03-13 10:05:46,686 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: null, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,686 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:46,686 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:46,723 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:46,723 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:46,849 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002/default_container_executor.sh]
2015-03-13 10:05:47,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,129 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:47,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,688 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,689 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:47,689 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,669 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,694 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,694 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:48,695 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,132 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,133 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:49,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,135 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,702 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,702 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:50,703 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,708 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:51,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,145 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,146 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,688 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,689 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:52,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:53,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:53,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:53,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61183, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000003_0_-845754463_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 174000
2015-03-13 10:05:53,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:53,653 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61184, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000000_0_1363540999_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 167000
2015-03-13 10:05:53,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job.split dst=null perm=null
2015-03-13 10:05:53,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,711 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,712 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,712 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:53,740 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61187, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000001_0_2142799520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 170000
2015-03-13 10:05:53,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61188, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000002_0_-1109876957_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 175000
2015-03-13 10:05:53,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:53,841 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61190, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000003_0_-845754463_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 169000
2015-03-13 10:05:53,858 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61189, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000004_0_-225619000_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741884_1060, duration: 173000
2015-03-13 10:05:53,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:53,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:53,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61191, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000001_0_2142799520_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 180000
2015-03-13 10:05:53,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:53,968 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61192, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000002_0_-1109876957_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 185000
2015-03-13 10:05:54,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:05:54,022 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61193, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000004_0_-225619000_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 170000
2015-03-13 10:05:54,152 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:05:54,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED dst=null perm=null
2015-03-13 10:05:54,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:05:54,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_FAIL dst=null perm=null
2015-03-13 10:05:54,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61195, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0005_m_000000_0_1363540999_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 199000
2015-03-13 10:05:54,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000003_0 dst=null perm=null
2015-03-13 10:05:54,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000000_0 dst=null perm=null
2015-03-13 10:05:54,496 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:54,497 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000005
2015-03-13 10:05:54,497 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,497 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,498 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000005
2015-03-13 10:05:54,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,510 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000005 is : 143
2015-03-13 10:05:54,514 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:54,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61198 dest: /127.0.0.1:60686
2015-03-13 10:05:54,517 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61199 dest: /127.0.0.1:60696
2015-03-13 10:05:54,518 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067 src: /127.0.0.1:61200 dest: /127.0.0.1:60689
2015-03-13 10:05:54,522 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist for DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:05:54,523 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,524 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000005 from application application_1426266260362_0005
2015-03-13 10:05:54,524 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,524 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000005
2015-03-13 10:05:54,539 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:05:54,541 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000002
2015-03-13 10:05:54,541 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,541 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,541 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000002
2015-03-13 10:05:54,542 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,542 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,558 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000002 is : 143
2015-03-13 10:05:54,571 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,571 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,572 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,573 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000002 from application application_1426266260362_0005
2015-03-13 10:05:54,573 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,573 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=null
2015-03-13 10:05:54,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:05:54,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:05:54,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000001_0 dst=null perm=null
2015-03-13 10:05:54,629 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,629 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000003
2015-03-13 10:05:54,629 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,630 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000002
2015-03-13 10:05:54,630 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,630 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,630 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,630 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000002
2015-03-13 10:05:54,631 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:54,631 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:6> numContainers=6 user=soberoi user-resources=<memory:8192, vCores:6>
2015-03-13 10:05:54,631 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,631 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,631 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:54,631 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000002 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:54,642 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000003 is : 143
2015-03-13 10:05:54,655 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:54,657 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,657 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000003 from application application_1426266260362_0005
2015-03-13 10:05:54,657 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,658 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000002_0 dst=null perm=null
2015-03-13 10:05:54,680 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000004
2015-03-13 10:05:54,680 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,681 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,681 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000004
2015-03-13 10:05:54,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,681 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000005
2015-03-13 10:05:54,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:54,682 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,682 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,682 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000005
2015-03-13 10:05:54,682 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:05:54,682 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:5> numContainers=5 user=soberoi user-resources=<memory:7168, vCores:5>
2015-03-13 10:05:54,683 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,683 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,683 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:54,683 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:05:54,695 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000004 is : 143
2015-03-13 10:05:54,709 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,711 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000004
2015-03-13 10:05:54,711 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,713 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,713 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000004 from application application_1426266260362_0005
2015-03-13 10:05:54,713 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,713 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:54,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_m_000004_0 dst=null perm=null
2015-03-13 10:05:54,747 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000006
2015-03-13 10:05:54,747 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:54,748 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:05:54,748 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000006
2015-03-13 10:05:54,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:54,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000004
2015-03-13 10:05:54,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:05:54,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:54,749 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:05:54,749 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000004
2015-03-13 10:05:54,749 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:05:54,749 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:4> numContainers=4 user=soberoi user-resources=<memory:6144, vCores:4>
2015-03-13 10:05:54,749 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,749 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:54,750 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:54,750 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000004 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:05:54,761 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000006 is : 143
2015-03-13 10:05:54,774 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:05:54,774 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:54,775 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:05:54,776 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000006 from application application_1426266260362_0005
2015-03-13 10:05:54,776 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:54,776 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:05:55,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:55,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.splitmetainfo dst=null perm=null
2015-03-13 10:05:55,140 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61202, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741887_1063, duration: 198000
2015-03-13 10:05:55,155 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:55,156 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:55,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:55,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000003
2015-03-13 10:05:55,631 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:55,631 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:05:55,631 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000003
2015-03-13 10:05:55,632 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:55,632 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:05:55,632 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,632 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,632 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:55,632 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000003 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:55,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:55,633 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:05:55,633 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:55,633 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0005 container=Container: [ContainerId: container_1426266260362_0005_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0005_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:55,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:05:55,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000006
2015-03-13 10:05:55,751 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:05:55,751 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:05:55,751 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000006
2015-03-13 10:05:55,751 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:05:55,751 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:05:55,751 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,751 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:55,751 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:05:55,751 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:05:55,963 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:55,965 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0006_000001
2015-03-13 10:05:55,966 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0006 APPATTEMPTID=appattempt_1426266260362_0006_000001
2015-03-13 10:05:55,966 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:05:55,966 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from ACCEPTED to RUNNING
2015-03-13 10:05:55,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:55,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:05:56,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:05:56,157 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,157 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,192 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:05:56,243 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61208 dest: /127.0.0.1:60696
2015-03-13 10:05:56,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61209 dest: /127.0.0.1:60693
2015-03-13 10:05:56,247 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068 src: /127.0.0.1:61210 dest: /127.0.0.1:60689
2015-03-13 10:05:56,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61210, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 7203000
2015-03-13 10:05:56,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:05:56,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,256 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61209, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 7902000
2015-03-13 10:05:56,257 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:56,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,257 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61208, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 9225000
2015-03-13 10:05:56,258 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:05:56,258 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741892_1068{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:05:56,262 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:05:56,548 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:56,556 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0005_01_000007 by user soberoi
2015-03-13 10:05:56,556 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:05:56,556 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0005_01_000007 to application application_1426266260362_0005
2015-03-13 10:05:56,556 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:05:56,557 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0005
2015-03-13 10:05:56,557 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0005
2015-03-13 10:05:56,557 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:56,557 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0005
2015-03-13 10:05:56,557 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:56,586 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:56,586 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:56,632 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:56,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:56,661 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007/default_container_executor.sh]
2015-03-13 10:05:57,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,413 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,414 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:05:57,414 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:05:57,414 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,414 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:05:57,414 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,415 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,415 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:05:57,415 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:57,415 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,416 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:05:57,416 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,416 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,416 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:05:57,416 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:05:57,417 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,417 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:05:57,417 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,417 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,417 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:05:57,418 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:05:57,418 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0006_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,418 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:05:57,418 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,554 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:05:57,636 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:57,637 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:05:57,637 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:05:57,637 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:05:57,637 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0006_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,637 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:05:57,638 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:05:57,997 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:57,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:05:58,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:58,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:58,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:58,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:58,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:05:58,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:05:58,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,169 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:58,169 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:05:58,173 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000007 by user soberoi
2015-03-13 10:05:58,174 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:58,174 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:05:58,175 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000006 by user soberoi
2015-03-13 10:05:58,175 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0006
2015-03-13 10:05:58,175 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:05:58,176 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000003 by user soberoi
2015-03-13 10:05:58,176 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:05:58,178 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:58,179 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000007 to application application_1426266260362_0006
2015-03-13 10:05:58,179 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:58,179 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,179 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,179 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,179 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,179 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,180 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from NEW to INITING
2015-03-13 10:05:58,180 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000007
2015-03-13 10:05:58,181 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000005 by user soberoi
2015-03-13 10:05:58,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:05:58,180 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000006 to application application_1426266260362_0006
2015-03-13 10:05:58,182 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000004 by user soberoi
2015-03-13 10:05:58,182 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000003 to application application_1426266260362_0006
2015-03-13 10:05:58,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:05:58,182 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000005 to application application_1426266260362_0006
2015-03-13 10:05:58,183 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000004 to application application_1426266260362_0006
2015-03-13 10:05:58,183 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from INITING to RUNNING
2015-03-13 10:05:58,183 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,183 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:05:58,184 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,184 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,184 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,185 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,185 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,185 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:05:58,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,185 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,185 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,186 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:05:58,186 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:05:58,186 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:05:58,187 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000006
2015-03-13 10:05:58,187 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000005
2015-03-13 10:05:58,188 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000004
2015-03-13 10:05:58,188 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0006_01_000003
2015-03-13 10:05:58,206 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000006.tokens. Credentials list:
2015-03-13 10:05:58,207 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000005.tokens. Credentials list:
2015-03-13 10:05:58,207 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000003.tokens. Credentials list:
2015-03-13 10:05:58,208 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0006_01_000007.tokens. Credentials list:
2015-03-13 10:05:58,208 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000004.tokens. Credentials list:
2015-03-13 10:05:58,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:58,233 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:58,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0006_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007.tokens
2015-03-13 10:05:58,347 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:58,348 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006.tokens
2015-03-13 10:05:58,348 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:58,416 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,417 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,418 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,418 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,419 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar dst=null perm=null
2015-03-13 10:05:58,458 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61219, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1715524015_3764, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 558000
2015-03-13 10:05:58,458 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61218, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-987417491_3763, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741883_1059, duration: 615000
2015-03-13 10:05:58,489 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,490 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml dst=null perm=null
2015-03-13 10:05:58,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61219, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1715524015_3764, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 277000
2015-03-13 10:05:58,530 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61220, bytes: 98738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-987417491_3763, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741889_1065, duration: 257000
2015-03-13 10:05:58,554 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,555 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:05:58,555 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,555 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:05:58,613 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,613 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,613 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,613 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,621 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,621 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:05:58,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:05:58,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:58,640 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:05:58,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007/default_container_executor.sh]
2015-03-13 10:05:58,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005/default_container_executor.sh]
2015-03-13 10:05:58,781 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006/default_container_executor.sh]
2015-03-13 10:05:58,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003/default_container_executor.sh]
2015-03-13 10:05:58,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004/default_container_executor.sh]
2015-03-13 10:05:59,018 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:05:59,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,423 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,424 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:59,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:05:59,749 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004.tokens
2015-03-13 10:05:59,749 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:05:59,875 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:05:59,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0006_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003.tokens
2015-03-13 10:05:59,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:00,094 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:00,166 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,243 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0006_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005.tokens
2015-03-13 10:06:00,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:00,328 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,429 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,429 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,429 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,430 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068
2015-03-13 10:06:00,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:00,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,435 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:01,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,439 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,440 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,654 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:02,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,180 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,180 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,287 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:03,444 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,444 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,444 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,445 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61227 dest: /127.0.0.1:60693
2015-03-13 10:06:03,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61228 dest: /127.0.0.1:60689
2015-03-13 10:06:03,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069 src: /127.0.0.1:61229 dest: /127.0.0.1:60696
2015-03-13 10:06:03,534 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61229, dest: /127.0.0.1:60696, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 32488000
2015-03-13 10:06:03,535 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,535 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,535 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61228, dest: /127.0.0.1:60689, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 33357000
2015-03-13 10:06:03,536 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,536 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,536 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61227, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 34355000
2015-03-13 10:06:03,536 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,537 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741893_1069{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,543 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0005_r_000000_0_1588355521_1
2015-03-13 10:06:03,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0 dst=null perm=null
2015-03-13 10:06:03,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0 dst=null perm=null
2015-03-13 10:06:03,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000 dst=null perm=null
2015-03-13 10:06:03,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/_temporary/attempt_1426266260362_0005_r_000000_0 dst=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:03,578 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:03,579 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000007
2015-03-13 10:06:03,579 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:03,579 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:03,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,586 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1 dst=null perm=null
2015-03-13 10:06:03,592 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0005_01_000007 is : 143
2015-03-13 10:06:03,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:03,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:03,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000 dst=null perm=null
2015-03-13 10:06:03,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000 dst=null perm=null
2015-03-13 10:06:03,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary/1/task_1426266260362_0005_r_000000/part-00000 dst=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,605 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:03,606 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:03,606 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:03,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000007
2015-03-13 10:06:03,607 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000007 from application application_1426266260362_0005
2015-03-13 10:06:03,607 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:03,608 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:06:03,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_temporary dst=null perm=null
2015-03-13 10:06:03,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,621 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/_SUCCESS is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,635 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,652 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61200, dest: /127.0.0.1:60689, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9131846000
2015-03-13 10:06:03,652 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,653 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,653 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61199, dest: /127.0.0.1:60696, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9132974000
2015-03-13 10:06:03,653 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,654 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,654 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61198, dest: /127.0.0.1:60686, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 9134445000
2015-03-13 10:06:03,655 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,655 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741891_1067{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,656 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,665 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:03,667 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61230 dest: /127.0.0.1:60696
2015-03-13 10:06:03,668 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61231 dest: /127.0.0.1:60686
2015-03-13 10:06:03,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070 src: /127.0.0.1:61232 dest: /127.0.0.1:60689
2015-03-13 10:06:03,672 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61232, dest: /127.0.0.1:60689, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 1269000
2015-03-13 10:06:03,672 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,673 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,673 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61231, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 1951000
2015-03-13 10:06:03,673 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,674 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,674 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61230, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 2796000
2015-03-13 10:06:03,674 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,674 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741894_1070{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,676 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist dst=null perm=null
2015-03-13 10:06:03,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:03,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist dst=null perm=null
2015-03-13 10:06:03,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:03,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1.jhist dst=null perm=null
2015-03-13 10:06:03,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,699 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61233, bytes: 67443, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067, duration: 291000
2015-03-13 10:06:03,701 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:03,702 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61234 dest: /127.0.0.1:60696
2015-03-13 10:06:03,704 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61235 dest: /127.0.0.1:60693
2015-03-13 10:06:03,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071 src: /127.0.0.1:61236 dest: /127.0.0.1:60689
2015-03-13 10:06:03,709 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61236, dest: /127.0.0.1:60689, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 1811000
2015-03-13 10:06:03,709 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,710 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61235, dest: /127.0.0.1:60693, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 2766000
2015-03-13 10:06:03,710 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,710 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,711 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61234, dest: /127.0.0.1:60696, bytes: 66919, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, duration: 3717000
2015-03-13 10:06:03,711 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,711 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,712 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741895_1071{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:03,714 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml dst=null perm=null
2015-03-13 10:06:03,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:03,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml dst=null perm=null
2015-03-13 10:06:03,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:03,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005/job_1426266260362_0005_1_conf.xml dst=null perm=null
2015-03-13 10:06:03,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:03,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61237, bytes: 91394, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741890_1066, duration: 292000
2015-03-13 10:06:03,731 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:03,733 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61238 dest: /127.0.0.1:60686
2015-03-13 10:06:03,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61239 dest: /127.0.0.1:60693
2015-03-13 10:06:03,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072 src: /127.0.0.1:61240 dest: /127.0.0.1:60696
2015-03-13 10:06:03,739 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61240, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 1752000
2015-03-13 10:06:03,740 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:03,740 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,740 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61239, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 2278000
2015-03-13 10:06:03,740 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,741 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,741 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61238, dest: /127.0.0.1:60686, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_24858168_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, duration: 3071000
2015-03-13 10:06:03,741 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:03,742 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741896_1072{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:03,743 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_24858168_1
2015-03-13 10:06:03,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:03,763 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:03,764 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0005
2015-03-13 10:06:03,764 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from RUNNING to REMOVING
2015-03-13 10:06:03,764 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0005
2015-03-13 10:06:03,764 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from REMOVING to FINISHING
2015-03-13 10:06:04,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,447 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,447 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,448 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,448 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,584 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:04,584 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000007
2015-03-13 10:06:04,584 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:04,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:04,585 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:04,585 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000007
2015-03-13 10:06:04,585 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:04,585 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:9216, vCores:7> numContainers=7 user=soberoi user-resources=<memory:9216, vCores:7>
2015-03-13 10:06:04,586 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:04,586 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:04,586 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:06:04,586 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000007 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:04,770 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741882_1058 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:06:04,770 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741884_1060 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:06:04,770 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741886_1062 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:04,770 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741888_1064 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:06:04,770 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741891_1067 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:06:04,771 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741890_1066 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:04,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0005 dst=null perm=null
2015-03-13 10:06:05,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,191 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,191 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,334 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,335 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,336 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,336 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,337 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741896_1072
2015-03-13 10:06:05,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,449 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,450 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:05,569 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741895_1071
2015-03-13 10:06:05,570 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070
2015-03-13 10:06:05,570 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741891_1067
2015-03-13 10:06:05,571 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069
2015-03-13 10:06:05,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,454 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,454 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,455 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,455 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,589 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:06,709 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:06,709 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060]
2015-03-13 10:06:07,195 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:07,378 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:07,379 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:07,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:07,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:07,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:07,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:07,459 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,459 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,459 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,460 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,594 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:07,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:06:07,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:06:07,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:06:08,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:06:08,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job.split dst=null perm=null
2015-03-13 10:06:08,156 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61250, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000003_0_789174002_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 165000
2015-03-13 10:06:08,157 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61251, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000004_0_2047450158_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 171000
2015-03-13 10:06:08,169 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61253, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000002_0_488524115_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 170000
2015-03-13 10:06:08,198 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,198 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,218 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61254, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000000_0_-1854404813_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 157000
2015-03-13 10:06:08,286 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61255, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000001_0_-1470236438_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741885_1061, duration: 169000
2015-03-13 10:06:08,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:08,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:08,308 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61256, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000003_0_789174002_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:06:08,312 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000004_0_2047450158_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 165000
2015-03-13 10:06:08,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:08,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61258, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000002_0_488524115_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 176000
2015-03-13 10:06:08,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:08,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:08,401 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61259, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000001_0_-1470236438_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:06:08,461 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,461 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,596 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000004_0 dst=null perm=null
2015-03-13 10:06:08,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000003_0 dst=null perm=null
2015-03-13 10:06:08,849 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:08,851 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000007
2015-03-13 10:06:08,851 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:08,851 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,852 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000007
2015-03-13 10:06:08,852 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,858 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:08,861 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000006
2015-03-13 10:06:08,861 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,861 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,862 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000006
2015-03-13 10:06:08,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,863 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,866 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000007 is : 143
2015-03-13 10:06:08,871 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:08,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61263 dest: /127.0.0.1:60696
2015-03-13 10:06:08,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61264 dest: /127.0.0.1:60689
2015-03-13 10:06:08,875 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000006 is : 143
2015-03-13 10:06:08,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073 src: /127.0.0.1:61265 dest: /127.0.0.1:60686
2015-03-13 10:06:08,881 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,882 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:08,882 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,882 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000007 from application application_1426266260362_0006
2015-03-13 10:06:08,882 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,882 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,882 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,882 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000007
2015-03-13 10:06:08,884 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist for DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:08,890 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,894 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000006
2015-03-13 10:06:08,895 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,896 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,896 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000006 from application application_1426266260362_0006
2015-03-13 10:06:08,896 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,896 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000002_0 dst=null perm=null
2015-03-13 10:06:08,930 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000005
2015-03-13 10:06:08,930 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,930 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,931 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000005
2015-03-13 10:06:08,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:08,932 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:08,932 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000006
2015-03-13 10:06:08,932 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:08,932 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:06:08,933 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000006
2015-03-13 10:06:08,933 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:06:08,933 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:6> numContainers=6 user=soberoi user-resources=<memory:8192, vCores:6>
2015-03-13 10:06:08,933 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,933 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,933 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:06:08,933 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000006 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:06:08,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61266, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0006_m_000000_0_-1854404813_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 171000
2015-03-13 10:06:08,942 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000005 is : 143
2015-03-13 10:06:08,955 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:08,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000005
2015-03-13 10:06:08,956 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,957 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:08,957 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000005 from application application_1426266260362_0006
2015-03-13 10:06:08,957 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:08,958 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:08,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000000_0 dst=null perm=null
2015-03-13 10:06:08,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_m_000001_0 dst=null perm=null
2015-03-13 10:06:08,995 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000004
2015-03-13 10:06:08,995 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:08,996 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000003
2015-03-13 10:06:08,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:08,996 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:08,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:08,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000005
2015-03-13 10:06:08,996 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,997 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:08,997 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:06:08,997 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000005
2015-03-13 10:06:08,997 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:06:08,997 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:5> numContainers=5 user=soberoi user-resources=<memory:7168, vCores:5>
2015-03-13 10:06:08,998 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,998 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:08,998 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:06:08,998 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:08,997 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:06:08,999 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000004
2015-03-13 10:06:09,014 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000004 is : 143
2015-03-13 10:06:09,025 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000003
2015-03-13 10:06:09,034 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000003 is : 143
2015-03-13 10:06:09,041 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:09,042 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:09,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000004
2015-03-13 10:06:09,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,045 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000003
2015-03-13 10:06:09,045 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:09,046 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:09,046 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:09,046 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:09,046 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000004 from application application_1426266260362_0006
2015-03-13 10:06:09,046 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,046 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:09,046 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000003 from application application_1426266260362_0006
2015-03-13 10:06:09,046 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,046 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:09,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:09,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:09,712 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741888_1064, blk_1073741890_1066, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:09,712 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741891_1067, blk_1073741882_1058, blk_1073741884_1060, blk_1073741886_1062]
2015-03-13 10:06:09,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:09,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000007
2015-03-13 10:06:09,856 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:09,856 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:09,856 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000007
2015-03-13 10:06:09,856 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:09,857 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:4> numContainers=4 user=soberoi user-resources=<memory:6144, vCores:4>
2015-03-13 10:06:09,857 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:09,857 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:09,857 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:09,858 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000007 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:09,915 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0005_01_000001 succeeded
2015-03-13 10:06:09,915 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:09,915 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005/container_1426266260362_0005_01_000001
2015-03-13 10:06:09,923 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:06:09,924 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0005_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:09,924 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0005_01_000001 from application application_1426266260362_0005
2015-03-13 10:06:09,924 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:09,924 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,000 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:10,001 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000003
2015-03-13 10:06:10,001 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:10,001 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000004
2015-03-13 10:06:10,002 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,002 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,003 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000003
2015-03-13 10:06:10,003 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:10,003 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:3> numContainers=3 user=soberoi user-resources=<memory:5120, vCores:3>
2015-03-13 10:06:10,003 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,004 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,004 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:10,004 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:10,004 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,004 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,004 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000004
2015-03-13 10:06:10,005 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:10,005 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:2> numContainers=2 user=soberoi user-resources=<memory:4096, vCores:2>
2015-03-13 10:06:10,005 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,005 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,005 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:10,005 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:10,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 5 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:10,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0005_01_000001
2015-03-13 10:06:10,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:10,203 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0005_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:10,204 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0005_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:10,203 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0005_000001
2015-03-13 10:06:10,204 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0005 CONTAINERID=container_1426266260362_0005_01_000001
2015-03-13 10:06:10,204 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0005_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:10,204 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0005_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:10,204 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0005 State change from FINISHING to FINISHED
2015-03-13 10:06:10,204 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:10,205 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0005_000001
2015-03-13 10:06:10,205 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0005
2015-03-13 10:06:10,205 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0005_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,205 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,206 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:06:10,205 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0005,name=[FC83D3BF82BA4B999048416E4B0AF853/1C978E7C0B2B420185FC2705C6894108] lower*upper/(1/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0005/jobhistory/job/job_1426266260362_0005,appMasterHost=Edinburgh.local,startTime=1426266337896,finishTime=1426266363764,finalStatus=SUCCEEDED
2015-03-13 10:06:10,206 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0005_000001 released container container_1426266260362_0005_01_000001 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:10,206 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:10,206 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:10,207 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:06:10,207 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0006 container=Container: [ContainerId: container_1426266260362_0006_01_000008, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0006_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,207 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:06:10,207 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:10,207 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0005_000001 is done. finalState=FINISHED
2015-03-13 10:06:10,207 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0005 requests cleared
2015-03-13 10:06:10,208 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0005 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:10,208 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0005 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:10,208 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0005_000001 (auth:SIMPLE)
2015-03-13 10:06:10,210 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0005_01_000001
2015-03-13 10:06:10,542 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888 for deletion
2015-03-13 10:06:10,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890 for deletion
2015-03-13 10:06:10,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:10,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741888_1064 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741888
2015-03-13 10:06:10,543 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:10,544 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:10,544 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741890_1066 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741890
2015-03-13 10:06:10,544 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:10,545 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:10,545 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:10,730 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891 for deletion
2015-03-13 10:06:10,730 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882 for deletion
2015-03-13 10:06:10,731 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884 for deletion
2015-03-13 10:06:10,731 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741891_1067 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741891
2015-03-13 10:06:10,731 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886 for deletion
2015-03-13 10:06:10,731 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741882_1058 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741882
2015-03-13 10:06:10,732 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741884_1060 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741884
2015-03-13 10:06:10,732 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741886_1062 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741886
2015-03-13 10:06:10,776 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:10,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,776 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,777 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:10,778 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:10,856 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:10,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,857 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:10,857 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:10,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:10,858 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:10,857 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,074 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:11,085 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:11,087 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0006_01_000008 by user soberoi
2015-03-13 10:06:11,087 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:11,087 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0006_01_000008 to application application_1426266260362_0006
2015-03-13 10:06:11,087 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:06:11,088 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0006
2015-03-13 10:06:11,088 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0006
2015-03-13 10:06:11,088 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:11,088 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0006
2015-03-13 10:06:11,088 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:11,114 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:11,114 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:11,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008/default_container_executor.sh]
2015-03-13 10:06:11,207 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:11,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:11,208 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:11,208 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:11,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0005
2015-03-13 10:06:11,209 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0005
2015-03-13 10:06:11,210 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0005 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:11,211 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0005, with delay of 10800 seconds
2015-03-13 10:06:12,084 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:06:12,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:12,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,217 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,217 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,623 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:13,681 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61273 dest: /127.0.0.1:60696
2015-03-13 10:06:13,682 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61274 dest: /127.0.0.1:60693
2015-03-13 10:06:13,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074 src: /127.0.0.1:61275 dest: /127.0.0.1:60686
2015-03-13 10:06:13,695 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61275, dest: /127.0.0.1:60686, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 10091000
2015-03-13 10:06:13,695 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,696 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,696 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61274, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 11044000
2015-03-13 10:06:13,697 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,697 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,698 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61273, dest: /127.0.0.1:60696, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 12474000
2015-03-13 10:06:13,698 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,698 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741898_1074{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,701 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0006_r_000000_0_-301781807_1
2015-03-13 10:06:13,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0 dst=null perm=null
2015-03-13 10:06:13,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0 dst=null perm=null
2015-03-13 10:06:13,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000 dst=null perm=null
2015-03-13 10:06:13,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/_temporary/attempt_1426266260362_0006_r_000000_0 dst=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:13,726 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000008
2015-03-13 10:06:13,726 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:13,726 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:06:13,726 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000008
2015-03-13 10:06:13,727 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:13,727 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:13,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,738 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,738 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0006_01_000008 is : 143
2015-03-13 10:06:13,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1 dst=null perm=null
2015-03-13 10:06:13,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:13,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:13,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000 dst=null perm=null
2015-03-13 10:06:13,752 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:13,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000 dst=null perm=null
2015-03-13 10:06:13,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,753 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,754 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,754 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000008
2015-03-13 10:06:13,755 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:13,755 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:13,755 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000008 from application application_1426266260362_0006
2015-03-13 10:06:13,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary/1/task_1426266260362_0006_r_000000/part-00000 dst=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,755 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:13,755 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:13,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_temporary dst=null perm=null
2015-03-13 10:06:13,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,765 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/_SUCCESS is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,768 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,782 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61265, dest: /127.0.0.1:60686, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4904054000
2015-03-13 10:06:13,782 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,783 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,784 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61264, dest: /127.0.0.1:60689, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4904762000
2015-03-13 10:06:13,784 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,785 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,785 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61263, dest: /127.0.0.1:60696, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 4906954000
2015-03-13 10:06:13,786 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,786 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741897_1073{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:13,787 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,791 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:13,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61276 dest: /127.0.0.1:60696
2015-03-13 10:06:13,794 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61277 dest: /127.0.0.1:60686
2015-03-13 10:06:13,796 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075 src: /127.0.0.1:61278 dest: /127.0.0.1:60689
2015-03-13 10:06:13,799 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61278, dest: /127.0.0.1:60689, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 1364000
2015-03-13 10:06:13,799 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,799 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,799 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61277, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 2027000
2015-03-13 10:06:13,800 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,800 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61276, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 2776000
2015-03-13 10:06:13,800 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,801 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741899_1075{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,802 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist dst=null perm=null
2015-03-13 10:06:13,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:13,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist dst=null perm=null
2015-03-13 10:06:13,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:13,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1.jhist dst=null perm=null
2015-03-13 10:06:13,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,821 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61279, bytes: 67425, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073, duration: 274000
2015-03-13 10:06:13,823 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:13,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61280 dest: /127.0.0.1:60689
2015-03-13 10:06:13,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61281 dest: /127.0.0.1:60686
2015-03-13 10:06:13,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076 src: /127.0.0.1:61282 dest: /127.0.0.1:60696
2015-03-13 10:06:13,830 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61282, dest: /127.0.0.1:60696, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 1851000
2015-03-13 10:06:13,831 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,831 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,831 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61281, dest: /127.0.0.1:60686, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 2315000
2015-03-13 10:06:13,831 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,832 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,832 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61280, dest: /127.0.0.1:60689, bytes: 66901, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, duration: 3104000
2015-03-13 10:06:13,832 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,833 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741900_1076{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:13,834 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml dst=null perm=null
2015-03-13 10:06:13,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:13,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml dst=null perm=null
2015-03-13 10:06:13,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:13,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006/job_1426266260362_0006_1_conf.xml dst=null perm=null
2015-03-13 10:06:13,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:13,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61283, bytes: 91394, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741892_1068, duration: 281000
2015-03-13 10:06:13,849 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:13,851 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61284 dest: /127.0.0.1:60696
2015-03-13 10:06:13,852 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61285 dest: /127.0.0.1:60693
2015-03-13 10:06:13,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077 src: /127.0.0.1:61286 dest: /127.0.0.1:60689
2015-03-13 10:06:13,857 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61286, dest: /127.0.0.1:60689, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 1835000
2015-03-13 10:06:13,858 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:13,858 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,858 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61285, dest: /127.0.0.1:60693, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 2450000
2015-03-13 10:06:13,858 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,859 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61284, dest: /127.0.0.1:60696, bytes: 90682, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_239879959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, duration: 3308000
2015-03-13 10:06:13,859 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:13,860 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741901_1077{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:13,861 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_239879959_1
2015-03-13 10:06:13,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:13,876 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:13,876 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0006
2015-03-13 10:06:13,876 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from RUNNING to REMOVING
2015-03-13 10:06:13,876 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0006
2015-03-13 10:06:13,876 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from REMOVING to FINISHING
2015-03-13 10:06:14,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:14,732 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:14,732 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000008
2015-03-13 10:06:14,733 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:14,733 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:06:14,733 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000008
2015-03-13 10:06:14,733 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:14,734 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:14,734 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000008, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:14,734 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:14,734 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:14,734 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000008 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:14,886 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741883_1059 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:14,886 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741885_1061 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:14,887 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741887_1063 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:06:14,887 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741889_1065 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:06:14,887 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741897_1073 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:06:14,887 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741892_1068 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:06:14,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0006 dst=null perm=null
2015-03-13 10:06:14,922 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (3/3) ...dpipesplatform/afterevery
2015-03-13 10:06:14,931 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:14,939 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:14,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:14,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:14,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:14,946 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 7
2015-03-13 10:06:14,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=null
2015-03-13 10:06:14,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:14,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:06:14,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:14,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,953 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:14,955 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61289 dest: /127.0.0.1:60696
2015-03-13 10:06:14,956 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61290 dest: /127.0.0.1:60686
2015-03-13 10:06:14,957 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61291 dest: /127.0.0.1:60689
2015-03-13 10:06:14,961 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61291, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 1777000
2015-03-13 10:06:14,961 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:14,962 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,962 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61290, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 2288000
2015-03-13 10:06:14,962 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,962 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,963 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61289, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 3375000
2015-03-13 10:06:14,963 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,964 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741902_1078{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:14,965 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:14,966 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar
2015-03-13 10:06:14,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:14,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:14,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:14,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:14,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:06:14,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:06:14,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:06:14,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:06:14,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:06:14,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:14,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:14,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:14,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:14,978 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:14,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:14,985 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split
2015-03-13 10:06:14,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:14,987 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:14,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61292 dest: /127.0.0.1:60689
2015-03-13 10:06:14,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61293 dest: /127.0.0.1:60696
2015-03-13 10:06:14,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61294 dest: /127.0.0.1:60693
2015-03-13 10:06:14,994 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079 src: /127.0.0.1:61295 dest: /127.0.0.1:60686
2015-03-13 10:06:14,998 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61295, dest: /127.0.0.1:60686, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 2010000
2015-03-13 10:06:14,998 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:14,999 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:14,999 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61294, dest: /127.0.0.1:60693, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 2500000
2015-03-13 10:06:14,999 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:14,999 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,000 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61293, dest: /127.0.0.1:60696, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 3610000
2015-03-13 10:06:15,000 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,000 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,001 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61292, dest: /127.0.0.1:60689, bytes: 352, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 4211000
2015-03-13 10:06:15,001 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,002 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741903_1079{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:15,003 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,007 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:15,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61296 dest: /127.0.0.1:60689
2015-03-13 10:06:15,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61297 dest: /127.0.0.1:60686
2015-03-13 10:06:15,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080 src: /127.0.0.1:61298 dest: /127.0.0.1:60693
2015-03-13 10:06:15,015 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61298, dest: /127.0.0.1:60693, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 1142000
2015-03-13 10:06:15,015 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:15,015 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,015 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61297, dest: /127.0.0.1:60686, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 1677000
2015-03-13 10:06:15,016 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,016 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,016 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61296, dest: /127.0.0.1:60689, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 2499000
2015-03-13 10:06:15,016 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,019 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741904_1080{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:15,020 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,020 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:06:15,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:15,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:15,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:15,025 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:15,042 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:15,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61299 dest: /127.0.0.1:60693
2015-03-13 10:06:15,045 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61300 dest: /127.0.0.1:60686
2015-03-13 10:06:15,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081 src: /127.0.0.1:61301 dest: /127.0.0.1:60689
2015-03-13 10:06:15,052 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61301, dest: /127.0.0.1:60689, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 4857000
2015-03-13 10:06:15,053 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:15,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,053 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61300, dest: /127.0.0.1:60686, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 5276000
2015-03-13 10:06:15,053 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,054 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,054 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61299, dest: /127.0.0.1:60693, bytes: 98258, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 6134000
2015-03-13 10:06:15,054 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:15,055 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741905_1081{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:15,058 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:15,058 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0007
2015-03-13 10:06:15,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=null
2015-03-13 10:06:15,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:15,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:15,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:15,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:15,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:15,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:15,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:15,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:15,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:15,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:15,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:15,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:15,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:15,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:15,073 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 7 submitted by user soberoi
2015-03-13 10:06:15,073 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0007
2015-03-13 10:06:15,073 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0007
2015-03-13 10:06:15,073 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0007
2015-03-13 10:06:15,073 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from NEW to NEW_SAVING
2015-03-13 10:06:15,073 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:15,073 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,074 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:15,074 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0007 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:15,074 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0007 from user: soberoi activated in queue: default
2015-03-13 10:06:15,074 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0007 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:15,074 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0007 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:15,074 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0007_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:15,074 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:15,074 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:15,076 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0007/
2015-03-13 10:06:15,076 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0007
2015-03-13 10:06:15,076 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0007/
2015-03-13 10:06:15,152 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,154 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,154 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,155 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,155 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,349 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,350 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,369 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,372 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,551 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,552 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,723 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073741902_1078 to datanode(s) 127.0.0.1:60693
2015-03-13 10:06:15,723 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741889_1065, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061]
2015-03-13 10:06:15,723 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741889_1065, blk_1073741892_1068, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:15,737 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:15,738 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:15,739 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:15,739 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:06:15,739 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0007 container=Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0007_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:15,739 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:15,739 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:15,739 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:15,740 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0007 AttemptId: appattempt_1426266260362_0007_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:06:15,741 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:15,741 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,741 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:15,741 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0007_000001
2015-03-13 10:06:15,742 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,742 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0007_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:06:15,744 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:15,746 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0007_01_000001 by user soberoi
2015-03-13 10:06:15,746 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0007
2015-03-13 10:06:15,746 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:15,746 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from NEW to INITING
2015-03-13 10:06:15,747 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0007_01_000001 to application application_1426266260362_0007
2015-03-13 10:06:15,747 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from INITING to RUNNING
2015-03-13 10:06:15,747 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0007_000001
2015-03-13 10:06:15,747 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:15,747 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:15,747 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0007
2015-03-13 10:06:15,747 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:15,748 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0007_01_000001
2015-03-13 10:06:15,750 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,750 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074
2015-03-13 10:06:15,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,757 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0007_01_000001.tokens. Credentials list:
2015-03-13 10:06:15,772 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:15,777 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:15,778 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079
2015-03-13 10:06:15,778 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741897_1073
2015-03-13 10:06:15,779 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075
2015-03-13 10:06:15,779 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741900_1076
2015-03-13 10:06:15,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0007_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001.tokens
2015-03-13 10:06:15,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:15,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:15,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:15,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:15,907 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61305, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 386000
2015-03-13 10:06:15,925 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:15,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:15,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:15,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:15,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61306, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 122000
2015-03-13 10:06:15,960 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:15,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:15,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:15,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741901_1077
2015-03-13 10:06:15,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080
2015-03-13 10:06:15,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:15,978 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081
2015-03-13 10:06:15,984 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61307, bytes: 356, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 150000
2015-03-13 10:06:15,996 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:16,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:16,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:16,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:16,021 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61307, bytes: 99026, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_440115166_4203, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 304000
2015-03-13 10:06:16,033 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:16,033 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:16,058 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:16,058 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:16,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001/default_container_executor.sh]
2015-03-13 10:06:16,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:16,380 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 to 127.0.0.1:60693
2015-03-13 10:06:16,380 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:16,381 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:16,383 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:16,383 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:06:16,383 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:16,383 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:16,382 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:16,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61308 dest: /127.0.0.1:60693
2015-03-13 10:06:16,384 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:16,383 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:16,384 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:16,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078 src: /127.0.0.1:61308 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:06:16,386 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741902_1078 size 254067
2015-03-13 10:06:16,741 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:16,742 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:16,742 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:17,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:17,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED dst=null perm=null
2015-03-13 10:06:17,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:06:17,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_FAIL dst=null perm=null
2015-03-13 10:06:17,746 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:17,747 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:17,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=null
2015-03-13 10:06:17,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:06:17,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:06:18,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:18,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:18,115 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61310, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741904_1080, duration: 141000
2015-03-13 10:06:18,724 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741892_1068, blk_1073741897_1073, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:18,724 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741889_1065, blk_1073741892_1068, blk_1073741883_1059, blk_1073741885_1061, blk_1073741887_1063]
2015-03-13 10:06:18,747 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:18,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:18,895 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:18,897 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0007_000001
2015-03-13 10:06:18,897 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0007 APPATTEMPTID=appattempt_1426266260362_0007_000001
2015-03-13 10:06:18,897 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:18,897 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from ACCEPTED to RUNNING
2015-03-13 10:06:18,917 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 683 Total time for transactions(ms): 29 Number of transactions batched in Syncs: 0 Number of syncs: 377 SyncTimes(ms): 124 97
2015-03-13 10:06:18,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:18,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:18,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:19,106 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:19,144 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61316 dest: /127.0.0.1:60696
2015-03-13 10:06:19,145 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61317 dest: /127.0.0.1:60686
2015-03-13 10:06:19,147 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082 src: /127.0.0.1:61318 dest: /127.0.0.1:60693
2015-03-13 10:06:19,157 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61318, dest: /127.0.0.1:60693, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 7503000
2015-03-13 10:06:19,157 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:19,158 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61317, dest: /127.0.0.1:60686, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 8079000
2015-03-13 10:06:19,158 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:19,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,160 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61316, dest: /127.0.0.1:60696, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 9606000
2015-03-13 10:06:19,160 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:19,160 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741906_1082{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:19,168 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:19,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889 for deletion
2015-03-13 10:06:19,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:19,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741889_1065 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741889
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:19,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:19,549 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:19,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892 for deletion
2015-03-13 10:06:19,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897 for deletion
2015-03-13 10:06:19,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883 for deletion
2015-03-13 10:06:19,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741892_1068 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741892
2015-03-13 10:06:19,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885 for deletion
2015-03-13 10:06:19,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887 for deletion
2015-03-13 10:06:19,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741897_1073 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741897
2015-03-13 10:06:19,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741883_1059 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741883
2015-03-13 10:06:19,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741885_1061 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741885
2015-03-13 10:06:19,743 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741887_1063 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741887
2015-03-13 10:06:19,751 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:19,752 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:20,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:20,019 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:20,019 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:20,020 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0007 container=Container: [ContainerId: container_1426266260362_0007_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0007_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,020 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:20,020 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,021 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0006_01_000002 succeeded
2015-03-13 10:06:20,021 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:20,021 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,029 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006/container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:06:20,030 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0006_01_000002 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:20,030 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0006_01_000002 from application application_1426266260362_0006
2015-03-13 10:06:20,030 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:20,030 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0006
2015-03-13 10:06:20,379 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078
2015-03-13 10:06:20,556 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,580 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 6 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0006_01_000002
2015-03-13 10:06:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:20,755 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0006_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:20,755 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0006_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:20,755 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0006 CONTAINERID=container_1426266260362_0006_01_000002
2015-03-13 10:06:20,755 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0006_000001
2015-03-13 10:06:20,756 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0006_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:20,756 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0006 State change from FINISHING to FINISHED
2015-03-13 10:06:20,756 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0006_01_000002 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:20,756 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0006_000001
2015-03-13 10:06:20,756 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0006
2015-03-13 10:06:20,757 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0006,name=[FC83D3BF82BA4B999048416E4B0AF853/1744C2BC8C1542818B6974502505089D] lower*upper/(2/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0006/jobhistory/job/job_1426266260362_0006,appMasterHost=Edinburgh.local,startTime=1426266337924,finishTime=1426266373876,finalStatus=SUCCEEDED
2015-03-13 10:06:20,756 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:06:20,757 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082
2015-03-13 10:06:20,757 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0006_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,757 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:20,757 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:06:20,757 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0006_000001 released container container_1426266260362_0006_01_000002 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:20,758 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0006_000001 is done. finalState=FINISHED
2015-03-13 10:06:20,758 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0006 requests cleared
2015-03-13 10:06:20,758 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0006 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:20,758 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0006 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:20,759 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0006_000001 (auth:SIMPLE)
2015-03-13 10:06:20,760 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0006_01_000002
2015-03-13 10:06:20,892 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:20,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,892 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,893 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:20,893 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:20,893 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:20,893 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:20,933 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:20,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:20,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:20,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:20,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:20,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:20,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:20,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:20,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:20,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:20,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:21,022 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:21,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,022 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:21,022 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,023 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:21,023 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:21,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,023 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,046 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:21,049 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0007_01_000002 by user soberoi
2015-03-13 10:06:21,049 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0007
2015-03-13 10:06:21,049 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:21,049 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from NEW to INITING
2015-03-13 10:06:21,050 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0007_01_000002 to application application_1426266260362_0007
2015-03-13 10:06:21,050 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from INITING to RUNNING
2015-03-13 10:06:21,050 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:21,050 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0007
2015-03-13 10:06:21,050 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0007
2015-03-13 10:06:21,050 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:21,050 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0007
2015-03-13 10:06:21,051 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:21,051 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:21,051 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0007_01_000002
2015-03-13 10:06:21,061 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0007_01_000002.tokens. Credentials list:
2015-03-13 10:06:21,075 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:21,141 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0007_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002.tokens
2015-03-13 10:06:21,141 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:21,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:21,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:21,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar dst=null perm=null
2015-03-13 10:06:21,218 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61323, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1357910065_4309, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741902_1078, duration: 384000
2015-03-13 10:06:21,237 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:21,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:21,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:21,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml dst=null perm=null
2015-03-13 10:06:21,264 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61324, bytes: 99026, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1357910065_4309, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741905_1081, duration: 337000
2015-03-13 10:06:21,276 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:21,277 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:21,303 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:21,303 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:21,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002/default_container_executor.sh]
2015-03-13 10:06:21,760 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:21,761 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:21,761 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0006
2015-03-13 10:06:21,761 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0006 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:21,762 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0006, with delay of 10800 seconds
2015-03-13 10:06:21,762 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,763 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,764 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,765 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0006
2015-03-13 10:06:21,947 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:06:22,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:22,028 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:22,762 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job.split dst=null perm=null
2015-03-13 10:06:23,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61327, bytes: 356, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741903_1079, duration: 194000
2015-03-13 10:06:23,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000 dst=null perm=null
2015-03-13 10:06:23,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C/part-00000 dst=null perm=null
2015-03-13 10:06:23,483 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61328, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741898_1074, duration: 195000
2015-03-13 10:06:23,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:23,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:23,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:23,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000 dst=null perm=null
2015-03-13 10:06:23,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F/part-00000 dst=null perm=null
2015-03-13 10:06:23,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61329, bytes: 184, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741893_1069, duration: 187000
2015-03-13 10:06:23,689 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:23,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61330 dest: /127.0.0.1:60689
2015-03-13 10:06:23,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61331 dest: /127.0.0.1:60686
2015-03-13 10:06:23,718 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083 src: /127.0.0.1:61332 dest: /127.0.0.1:60693
2015-03-13 10:06:23,723 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61332, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 4066000
2015-03-13 10:06:23,724 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,724 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,724 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61331, dest: /127.0.0.1:60686, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 4646000
2015-03-13 10:06:23,724 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,725 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,725 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61330, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 5448000
2015-03-13 10:06:23,725 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741907_1083{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,729 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0007_m_000000_0_-1764019373_1
2015-03-13 10:06:23,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0 dst=null perm=null
2015-03-13 10:06:23,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0 dst=null perm=null
2015-03-13 10:06:23,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000 dst=null perm=null
2015-03-13 10:06:23,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/_temporary/attempt_1426266260362_0007_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:23,764 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0007_01_000002
2015-03-13 10:06:23,764 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:23,765 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:06:23,765 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0007_01_000002
2015-03-13 10:06:23,765 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:23,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:23,774 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0007_01_000002 is : 143
2015-03-13 10:06:23,780 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:23,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61333 dest: /127.0.0.1:60693
2015-03-13 10:06:23,782 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61334 dest: /127.0.0.1:60686
2015-03-13 10:06:23,785 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084 src: /127.0.0.1:61335 dest: /127.0.0.1:60689
2015-03-13 10:06:23,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1 dst=null perm=null
2015-03-13 10:06:23,787 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:23,787 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,787 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:23,788 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:23,788 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0007_01_000002 from application application_1426266260362_0007
2015-03-13 10:06:23,788 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:23,789 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0007
2015-03-13 10:06:23,791 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist for DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:23,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:23,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000 dst=null perm=null
2015-03-13 10:06:23,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2015-03-13 10:06:23,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary/1/task_1426266260362_0007_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary dst=null perm=null
2015-03-13 10:06:23,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,813 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_SUCCESS is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,817 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,828 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61335, dest: /127.0.0.1:60689, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 41819000
2015-03-13 10:06:23,828 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,831 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,831 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61334, dest: /127.0.0.1:60686, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 44663000
2015-03-13 10:06:23,831 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,832 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,832 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61333, dest: /127.0.0.1:60693, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 45453000
2015-03-13 10:06:23,832 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,832 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741908_1084{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:23,834 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,837 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:23,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61336 dest: /127.0.0.1:60686
2015-03-13 10:06:23,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61337 dest: /127.0.0.1:60696
2015-03-13 10:06:23,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085 src: /127.0.0.1:61338 dest: /127.0.0.1:60693
2015-03-13 10:06:23,845 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61338, dest: /127.0.0.1:60693, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 1514000
2015-03-13 10:06:23,845 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,845 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61337, dest: /127.0.0.1:60696, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 2108000
2015-03-13 10:06:23,846 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,846 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61336, dest: /127.0.0.1:60686, bytes: 439, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 3069000
2015-03-13 10:06:23,847 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741909_1085{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:23,848 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist dst=null perm=null
2015-03-13 10:06:23,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:23,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist dst=null perm=null
2015-03-13 10:06:23,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:23,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1.jhist dst=null perm=null
2015-03-13 10:06:23,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,870 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61339, bytes: 23268, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084, duration: 145000
2015-03-13 10:06:23,871 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:23,873 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61340 dest: /127.0.0.1:60689
2015-03-13 10:06:23,874 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61341 dest: /127.0.0.1:60686
2015-03-13 10:06:23,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086 src: /127.0.0.1:61342 dest: /127.0.0.1:60696
2015-03-13 10:06:23,878 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61342, dest: /127.0.0.1:60696, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 1442000
2015-03-13 10:06:23,878 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,879 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61341, dest: /127.0.0.1:60686, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 2035000
2015-03-13 10:06:23,879 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,879 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,880 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61340, dest: /127.0.0.1:60689, bytes: 23084, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, duration: 2790000
2015-03-13 10:06:23,880 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,880 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741910_1086{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:23,882 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml dst=null perm=null
2015-03-13 10:06:23,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:23,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml dst=null perm=null
2015-03-13 10:06:23,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:23,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007/job_1426266260362_0007_1_conf.xml dst=null perm=null
2015-03-13 10:06:23,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:23,894 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61343, bytes: 91809, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741906_1082, duration: 269000
2015-03-13 10:06:23,895 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:23,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61344 dest: /127.0.0.1:60693
2015-03-13 10:06:23,899 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61345 dest: /127.0.0.1:60696
2015-03-13 10:06:23,900 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087 src: /127.0.0.1:61346 dest: /127.0.0.1:60686
2015-03-13 10:06:23,903 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61346, dest: /127.0.0.1:60686, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 2027000
2015-03-13 10:06:23,904 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:23,904 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,904 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61345, dest: /127.0.0.1:60696, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 2704000
2015-03-13 10:06:23,904 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,905 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,905 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61344, dest: /127.0.0.1:60693, bytes: 91097, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_771583040_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, duration: 3491000
2015-03-13 10:06:23,905 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:23,906 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741911_1087{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:23,907 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_771583040_1
2015-03-13 10:06:23,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:23,921 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:23,921 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0007
2015-03-13 10:06:23,921 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from RUNNING to REMOVING
2015-03-13 10:06:23,922 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0007
2015-03-13 10:06:23,922 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from REMOVING to FINISHING
2015-03-13 10:06:24,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:24,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0007_01_000002
2015-03-13 10:06:24,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:24,768 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:24,769 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0007_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:24,769 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000002
2015-03-13 10:06:24,769 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0007_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:24,769 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:24,769 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0007_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:24,770 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:24,770 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:24,770 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0007_000001 released container container_1426266260362_0007_01_000002 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:24,928 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741902_1078 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:06:24,928 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741903_1079 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:24,928 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741904_1080 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:06:24,928 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741905_1081 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:06:24,929 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741908_1084 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:06:24,929 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741906_1082 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:06:24,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0007 dst=null perm=null
2015-03-13 10:06:24,960 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741893_1069 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:06:24,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/3391551687_upper_6F2967859C074FB3A05AC9B5C5BE893F dst=null perm=null
2015-03-13 10:06:24,961 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741898_1074 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:24,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5116607014_lower_9AD2589890154BF394AB0F3C492A089C dst=null perm=null
2015-03-13 10:06:24,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,962 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary
2015-03-13 10:06:24,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/_temporary dst=null perm=null
2015-03-13 10:06:24,970 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:24,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:24,971 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:24,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,974 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:24,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2015-03-13 10:06:24,977 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61347, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 178000
2015-03-13 10:06:24,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:24,984 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:24,985 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:24,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,988 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:24,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2015-03-13 10:06:24,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 186000
2015-03-13 10:06:24,991 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/afterevery
2015-03-13 10:06:24,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery dst=null perm=null
2015-03-13 10:06:24,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2015-03-13 10:06:24,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/afterevery/part-00000 dst=null perm=null
2015-03-13 10:06:24,997 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61347, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083, duration: 227000
2015-03-13 10:06:24,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:25,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:25,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:25,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:25,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,005 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:25,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61349 dest: /127.0.0.1:60689
2015-03-13 10:06:25,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61350 dest: /127.0.0.1:60686
2015-03-13 10:06:25,009 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088 src: /127.0.0.1:61351 dest: /127.0.0.1:60696
2015-03-13 10:06:25,011 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61351, dest: /127.0.0.1:60696, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 1035000
2015-03-13 10:06:25,011 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,012 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,012 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61350, dest: /127.0.0.1:60686, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 1429000
2015-03-13 10:06:25,012 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,012 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,013 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61349, dest: /127.0.0.1:60689, bytes: 52, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 2425000
2015-03-13 10:06:25,013 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,014 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741912_1088{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,015 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,020 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:25,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61352 dest: /127.0.0.1:60696
2015-03-13 10:06:25,022 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61353 dest: /127.0.0.1:60686
2015-03-13 10:06:25,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089 src: /127.0.0.1:61354 dest: /127.0.0.1:60689
2015-03-13 10:06:25,026 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61354, dest: /127.0.0.1:60689, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 1273000
2015-03-13 10:06:25,026 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,026 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61353, dest: /127.0.0.1:60686, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 1715000
2015-03-13 10:06:25,027 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,027 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61352, dest: /127.0.0.1:60696, bytes: 51, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 2515000
2015-03-13 10:06:25,027 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,028 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741913_1089{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,029 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,040 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:25,041 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:06:25,042 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:06:25,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:25,075 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:06:25,075 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:06:25,075 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin"]
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] parallel execution is enabled: true
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting jobs: 1
2015-03-13 10:06:25,076 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] allocating threads: 1
2015-03-13 10:06:25,077 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/1) ...intocogrouplhsswappedjoin
2015-03-13 10:06:25,084 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,092 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:25,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:25,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:25,096 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 8
2015-03-13 10:06:25,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=null
2015-03-13 10:06:25,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:25,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:06:25,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,103 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:06:25,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61355 dest: /127.0.0.1:60696
2015-03-13 10:06:25,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61356 dest: /127.0.0.1:60686
2015-03-13 10:06:25,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61357 dest: /127.0.0.1:60689
2015-03-13 10:06:25,110 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61357, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 1923000
2015-03-13 10:06:25,111 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,111 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61356, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 2399000
2015-03-13 10:06:25,112 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,112 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,112 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61355, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 3553000
2015-03-13 10:06:25,112 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,114 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741914_1090{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:06:25,115 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,116 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar
2015-03-13 10:06:25,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:25,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:25,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:25,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:06:25,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:06:25,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:06:25,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:06:25,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:06:25,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:25,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:25,125 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:25,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,127 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:25,129 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:25,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,131 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:25,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:25,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,135 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split
2015-03-13 10:06:25,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:25,137 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:25,138 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61358 dest: /127.0.0.1:60686
2015-03-13 10:06:25,139 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61359 dest: /127.0.0.1:60693
2015-03-13 10:06:25,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61360 dest: /127.0.0.1:60689
2015-03-13 10:06:25,141 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091 src: /127.0.0.1:61361 dest: /127.0.0.1:60696
2015-03-13 10:06:25,144 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61361, dest: /127.0.0.1:60696, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 1571000
2015-03-13 10:06:25,144 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,144 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,145 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61360, dest: /127.0.0.1:60689, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 2019000
2015-03-13 10:06:25,145 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,145 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,146 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61359, dest: /127.0.0.1:60693, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 3062000
2015-03-13 10:06:25,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,146 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,146 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61358, dest: /127.0.0.1:60686, bytes: 1778, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 3698000
2015-03-13 10:06:25,147 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741915_1091{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:25,148 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,153 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:25,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61362 dest: /127.0.0.1:60696
2015-03-13 10:06:25,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61363 dest: /127.0.0.1:60686
2015-03-13 10:06:25,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092 src: /127.0.0.1:61364 dest: /127.0.0.1:60693
2015-03-13 10:06:25,160 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61364, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 1252000
2015-03-13 10:06:25,160 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,161 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61363, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 1903000
2015-03-13 10:06:25,161 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,162 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61362, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 2720000
2015-03-13 10:06:25,162 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,163 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741916_1092{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:25,164 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,164 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:06:25,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:25,168 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:25,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:25,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapred.output.value.groupfn.class is deprecated. Instead, use mapreduce.job.output.group.comparator.class
2015-03-13 10:06:25,169 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:25,172 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:25,173 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61365 dest: /127.0.0.1:60689
2015-03-13 10:06:25,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61366 dest: /127.0.0.1:60693
2015-03-13 10:06:25,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093 src: /127.0.0.1:61367 dest: /127.0.0.1:60686
2015-03-13 10:06:25,178 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61367, dest: /127.0.0.1:60686, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 1494000
2015-03-13 10:06:25,179 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:25,179 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,179 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61366, dest: /127.0.0.1:60693, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 2070000
2015-03-13 10:06:25,179 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,180 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,180 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61365, dest: /127.0.0.1:60689, bytes: 100918, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 2826000
2015-03-13 10:06:25,180 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:25,180 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741917_1093{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:25,182 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:25,182 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0008
2015-03-13 10:06:25,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=null
2015-03-13 10:06:25,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:25,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:25,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:25,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:25,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:25,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:25,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:25,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:25,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:25,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:25,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:25,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:25,193 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 8 submitted by user soberoi
2015-03-13 10:06:25,193 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0008
2015-03-13 10:06:25,193 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0008
2015-03-13 10:06:25,193 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0008
2015-03-13 10:06:25,193 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from NEW to NEW_SAVING
2015-03-13 10:06:25,193 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:25,194 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,194 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:25,194 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0008 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:25,194 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0008 from user: soberoi activated in queue: default
2015-03-13 10:06:25,194 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0008 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:25,194 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0008 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:25,194 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0008_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:25,194 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:25,195 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:25,196 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0008/
2015-03-13 10:06:25,197 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0008
2015-03-13 10:06:25,197 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0008/
2015-03-13 10:06:25,559 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,560 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,586 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,587 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,588 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,588 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,589 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741911_1087
2015-03-13 10:06:25,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,761 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,771 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:25,772 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:25,772 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:25,772 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:06:25,772 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:25,773 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:25,773 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:25,773 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:25,774 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0008 AttemptId: appattempt_1426266260362_0008_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:06:25,774 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:25,774 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,775 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:25,775 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0008_000001
2015-03-13 10:06:25,775 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,776 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0008_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:06:25,778 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:25,780 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000001 by user soberoi
2015-03-13 10:06:25,780 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0008
2015-03-13 10:06:25,780 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:25,780 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from NEW to INITING
2015-03-13 10:06:25,780 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000001 to application application_1426266260362_0008
2015-03-13 10:06:25,780 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from INITING to RUNNING
2015-03-13 10:06:25,781 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0008_000001
2015-03-13 10:06:25,781 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:25,781 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:25,781 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:25,781 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,781 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:25,782 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000001
2015-03-13 10:06:25,790 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0008_01_000001.tokens. Credentials list:
2015-03-13 10:06:25,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:25,876 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0008_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001.tokens
2015-03-13 10:06:25,876 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:25,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:25,940 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 551000
2015-03-13 10:06:25,959 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:25,960 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:25,960 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,962 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:25,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085
2015-03-13 10:06:25,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092
2015-03-13 10:06:25,964 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:25,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:25,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:25,982 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741907_1083
2015-03-13 10:06:25,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093
2015-03-13 10:06:25,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088
2015-03-13 10:06:25,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091
2015-03-13 10:06:25,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741908_1084
2015-03-13 10:06:25,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089
2015-03-13 10:06:25,985 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741910_1086
2015-03-13 10:06:25,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61371, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 154000
2015-03-13 10:06:25,998 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:26,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:26,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:26,022 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 1794, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 192000
2015-03-13 10:06:26,034 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:26,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:26,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:26,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61348, bytes: 101710, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_711767688_4481, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 312000
2015-03-13 10:06:26,071 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:26,071 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:26,096 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:26,096 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:26,168 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001/default_container_executor.sh]
2015-03-13 10:06:26,187 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:26,774 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:26,774 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:26,775 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:27,736 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741914_1090 to datanode(s) 127.0.0.1:60693
2015-03-13 10:06:27,737 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741908_1084, blk_1073741893_1069, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:27,737 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741906_1082, blk_1073741893_1069, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:27,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:27,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED dst=null perm=null
2015-03-13 10:06:27,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:06:27,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_FAIL dst=null perm=null
2015-03-13 10:06:27,779 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:27,779 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:27,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=null
2015-03-13 10:06:27,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:06:27,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:06:28,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:28,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:28,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61373, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741916_1092, duration: 133000
2015-03-13 10:06:28,389 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:28,389 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 to 127.0.0.1:60693
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:28,390 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:28,391 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:28,391 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61376 dest: /127.0.0.1:60693
2015-03-13 10:06:28,392 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:28,392 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:06:28,392 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:28,393 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090 src: /127.0.0.1:61376 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:06:28,394 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741914_1090 size 254067
2015-03-13 10:06:28,747 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:28,747 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:28,747 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:28,747 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:28,748 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:28,781 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:28,781 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:28,949 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:28,950 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0008_000001
2015-03-13 10:06:28,950 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0008 APPATTEMPTID=appattempt_1426266260362_0008_000001
2015-03-13 10:06:28,951 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:28,951 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from ACCEPTED to RUNNING
2015-03-13 10:06:28,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:28,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:29,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:29,158 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:06:29,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61380 dest: /127.0.0.1:60686
2015-03-13 10:06:29,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61381 dest: /127.0.0.1:60693
2015-03-13 10:06:29,200 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094 src: /127.0.0.1:61382 dest: /127.0.0.1:60696
2015-03-13 10:06:29,209 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61382, dest: /127.0.0.1:60696, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 6690000
2015-03-13 10:06:29,210 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:29,211 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61381, dest: /127.0.0.1:60693, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 6507000
2015-03-13 10:06:29,211 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:29,211 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,212 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,212 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61380, dest: /127.0.0.1:60686, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 8118000
2015-03-13 10:06:29,213 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:29,213 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741918_1094{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:06:29,217 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:29,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:29,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:30,064 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0007_01_000001 succeeded
2015-03-13 10:06:30,064 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:30,065 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:30,073 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0007_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:30,073 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007/container_1426266260362_0007_01_000001
2015-03-13 10:06:30,074 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0007_01_000001 from application application_1426266260362_0007
2015-03-13 10:06:30,074 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:30,074 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0007
2015-03-13 10:06:30,596 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,738 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741908_1084, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:30,738 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741904_1080, blk_1073741905_1081, blk_1073741906_1082, blk_1073741908_1084, blk_1073741893_1069, blk_1073741898_1074, blk_1073741902_1078, blk_1073741903_1079]
2015-03-13 10:06:30,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 7 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:30,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:30,792 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0007_01_000001
2015-03-13 10:06:30,793 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,793 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:30,793 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:06:30,793 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,794 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:30,794 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,794 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,794 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:30,795 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:06:30,795 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0008_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,795 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:30,795 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,796 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0007_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:30,796 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0007_000001
2015-03-13 10:06:30,796 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0007_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:30,796 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0007_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:30,796 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0007 CONTAINERID=container_1426266260362_0007_01_000001
2015-03-13 10:06:30,796 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0007 State change from FINISHING to FINISHED
2015-03-13 10:06:30,796 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0007_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:30,796 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0007
2015-03-13 10:06:30,796 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:06:30,797 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0007,name=[FC83D3BF82BA4B999048416E4B0AF853/28CD4D9B5CB64D6CB627C92EC12090D1] lower*upper/(3/3) ...dpipesplatform/afterevery,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0007/jobhistory/job/job_1426266260362_0007,appMasterHost=Edinburgh.local,startTime=1426266375072,finishTime=1426266383922,finalStatus=SUCCEEDED
2015-03-13 10:06:30,796 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0007_000001
2015-03-13 10:06:30,797 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0007_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,797 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,797 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:06:30,797 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0007_000001 released container container_1426266260362_0007_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:30,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090
2015-03-13 10:06:30,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,798 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:30,798 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:30,798 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,798 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4
2015-03-13 10:06:30,798 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,799 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,799 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:30,799 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:06:30,799 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,799 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:06:30,800 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,800 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0007_000001 (auth:SIMPLE)
2015-03-13 10:06:30,800 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:30,800 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:30,800 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:06:30,801 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,801 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:06:30,801 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:30,801 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0007_01_000001
2015-03-13 10:06:30,801 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0007_000001 is done. finalState=FINISHED
2015-03-13 10:06:30,801 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0007 requests cleared
2015-03-13 10:06:30,801 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0007 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:30,802 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0007 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:30,966 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,970 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094
2015-03-13 10:06:30,984 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:30,985 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:31,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:31,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:31,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:31,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:31,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:31,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:31,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:31,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:31,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:31,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:31,108 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:31,108 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:31,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000006 by user soberoi
2015-03-13 10:06:31,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000002 by user soberoi
2015-03-13 10:06:31,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0008
2015-03-13 10:06:31,112 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:31,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000004 by user soberoi
2015-03-13 10:06:31,112 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:31,113 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000003 by user soberoi
2015-03-13 10:06:31,113 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from NEW to INITING
2015-03-13 10:06:31,112 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000005 by user soberoi
2015-03-13 10:06:31,113 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:31,112 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:31,113 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000006 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000004 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000005 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from INITING to RUNNING
2015-03-13 10:06:31,113 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:31,113 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000002 to application application_1426266260362_0008
2015-03-13 10:06:31,114 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000003 to application application_1426266260362_0008
2015-03-13 10:06:31,115 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,114 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,115 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:06:31,115 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,115 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,116 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:31,116 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:31,115 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,117 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,117 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,116 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:31,117 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:31,117 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,118 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,117 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:31,118 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,118 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000006
2015-03-13 10:06:31,121 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000005
2015-03-13 10:06:31,124 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0008_01_000004
2015-03-13 10:06:31,146 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0008_01_000004.tokens. Credentials list:
2015-03-13 10:06:31,146 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000006.tokens. Credentials list:
2015-03-13 10:06:31,147 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000005.tokens. Credentials list:
2015-03-13 10:06:31,158 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,158 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,164 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,164 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,169 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:31,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003/default_container_executor.sh]
2015-03-13 10:06:31,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002/default_container_executor.sh]
2015-03-13 10:06:31,268 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0008_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004.tokens
2015-03-13 10:06:31,268 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:31,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:31,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:31,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar dst=null perm=null
2015-03-13 10:06:31,384 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61388, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_481678973_4634, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741914_1090, duration: 472000
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:31,395 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:31,395 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:31,394 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:31,395 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:31,395 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:31,395 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:31,396 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:31,396 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:31,414 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:31,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:31,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:31,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml dst=null perm=null
2015-03-13 10:06:31,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61388, bytes: 101710, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_481678973_4634, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741917_1093, duration: 229000
2015-03-13 10:06:31,469 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:31,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:31,517 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,517 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,518 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,518 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,519 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:31,519 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:31,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904 for deletion
2015-03-13 10:06:31,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905 for deletion
2015-03-13 10:06:31,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906 for deletion
2015-03-13 10:06:31,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908 for deletion
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893 for deletion
2015-03-13 10:06:31,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741904_1080 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741904
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741905_1081 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741905
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898 for deletion
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741893_1069 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741893
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741906_1082 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741906
2015-03-13 10:06:31,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741908_1084 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741908
2015-03-13 10:06:31,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741898_1074 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741898
2015-03-13 10:06:31,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902 for deletion
2015-03-13 10:06:31,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903 for deletion
2015-03-13 10:06:31,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741902_1078 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741902
2015-03-13 10:06:31,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741903_1079 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741903
2015-03-13 10:06:31,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004/default_container_executor.sh]
2015-03-13 10:06:31,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005/default_container_executor.sh]
2015-03-13 10:06:31,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006/default_container_executor.sh]
2015-03-13 10:06:31,796 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,796 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:31,797 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:31,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,797 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:31,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,798 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0007
2015-03-13 10:06:31,798 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0007
2015-03-13 10:06:31,799 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:31,799 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0007 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:31,799 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0007, with delay of 10800 seconds
2015-03-13 10:06:31,799 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,799 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0007, with delay of 10800 seconds
2015-03-13 10:06:31,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:31,798 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:31,800 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0007
2015-03-13 10:06:32,000 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:06:32,500 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:32,619 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005.tokens
2015-03-13 10:06:32,619 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:32,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,798 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:32,855 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0008_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006.tokens
2015-03-13 10:06:32,856 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:33,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:33,801 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,803 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:34,804 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:35,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,807 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:36,808 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:37,809 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,812 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:38,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:39,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:39,185 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61398, bytes: 1794, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000000_0_675622110_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 152000
2015-03-13 10:06:39,239 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61399, bytes: 1794, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000001_0_266420541_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 165000
2015-03-13 10:06:39,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:39,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:39,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:39,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61403, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000000_0_675622110_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 196000
2015-03-13 10:06:39,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:39,435 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61402, bytes: 762, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 164000
2015-03-13 10:06:39,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job.split dst=null perm=null
2015-03-13 10:06:39,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61405, bytes: 762, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 182000
2015-03-13 10:06:39,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:39,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61406, bytes: 1278, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741915_1091, duration: 154000
2015-03-13 10:06:39,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61407, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 187000
2015-03-13 10:06:39,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:39,674 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61405, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:06:39,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:39,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,813 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,814 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,870 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61408, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000001_0_266420541_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 164000
2015-03-13 10:06:39,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000000_0 dst=null perm=null
2015-03-13 10:06:39,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000002
2015-03-13 10:06:39,918 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,918 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:06:39,918 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000002
2015-03-13 10:06:39,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:39,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,931 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000002 is : 143
2015-03-13 10:06:39,933 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:39,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61409 dest: /127.0.0.1:60696
2015-03-13 10:06:39,936 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61410 dest: /127.0.0.1:60689
2015-03-13 10:06:39,937 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095 src: /127.0.0.1:61411 dest: /127.0.0.1:60693
2015-03-13 10:06:39,941 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist for DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:39,944 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:39,944 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,944 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,944 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:39,945 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000002
2015-03-13 10:06:39,945 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000002 from application application_1426266260362_0008
2015-03-13 10:06:39,946 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:39,946 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:39,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000001_0 dst=null perm=null
2015-03-13 10:06:39,984 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:06:39,985 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000003
2015-03-13 10:06:39,985 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:39,985 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:39,985 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000002
2015-03-13 10:06:39,986 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:39,986 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:39,986 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:06:39,986 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000002
2015-03-13 10:06:39,986 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:06:39,987 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:06:39,987 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:39,987 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:39,987 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:06:39,987 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:06:39,998 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000003 is : 143
2015-03-13 10:06:40,008 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,009 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,009 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,009 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:40,010 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,010 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000003 from application application_1426266260362_0008
2015-03-13 10:06:40,011 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,011 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,157 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61412, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 166000
2015-03-13 10:06:40,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,172 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61413, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000004_0_288813979_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 166000
2015-03-13 10:06:40,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000004_0 dst=null perm=null
2015-03-13 10:06:40,207 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000006
2015-03-13 10:06:40,207 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,207 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,207 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000006
2015-03-13 10:06:40,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,208 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,222 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000006 is : 143
2015-03-13 10:06:40,235 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,235 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000006
2015-03-13 10:06:40,237 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,237 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,237 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000006 from application application_1426266260362_0008
2015-03-13 10:06:40,238 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,238 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61414, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:06:40,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,274 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61415, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000003_0_-1274735834_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 158000
2015-03-13 10:06:40,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:40,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61416, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:06:40,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:40,291 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61417, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 165000
2015-03-13 10:06:40,294 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61416, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0008_m_000002_0_-1826248674_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 128000
2015-03-13 10:06:40,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000003_0 dst=null perm=null
2015-03-13 10:06:40,311 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000005
2015-03-13 10:06:40,311 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,311 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,312 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,312 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000006
2015-03-13 10:06:40,313 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000005
2015-03-13 10:06:40,313 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,313 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,314 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000006
2015-03-13 10:06:40,314 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:06:40,314 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:06:40,314 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,314 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,314 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:06:40,314 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000006 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:40,325 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000005 is : 143
2015-03-13 10:06:40,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_m_000002_0 dst=null perm=null
2015-03-13 10:06:40,334 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,334 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,335 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000005
2015-03-13 10:06:40,336 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,336 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,336 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000005 from application application_1426266260362_0008
2015-03-13 10:06:40,336 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,337 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,343 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000004
2015-03-13 10:06:40,343 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:40,343 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:06:40,344 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000004
2015-03-13 10:06:40,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:40,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000005
2015-03-13 10:06:40,345 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,345 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,345 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000005
2015-03-13 10:06:40,345 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:06:40,345 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:06:40,345 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,346 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,346 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:06:40,346 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:06:40,356 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000004 is : 143
2015-03-13 10:06:40,368 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:40,369 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000004
2015-03-13 10:06:40,369 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:40,370 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:40,370 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000004 from application application_1426266260362_0008
2015-03-13 10:06:40,370 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:40,370 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:40,992 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:40,992 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:40,992 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000003
2015-03-13 10:06:40,993 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:40,993 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:06:40,993 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000003
2015-03-13 10:06:40,993 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:40,994 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:06:40,994 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,994 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:40,994 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:06:40,994 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:41,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:41,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000004
2015-03-13 10:06:41,349 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:41,349 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:06:41,349 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000004
2015-03-13 10:06:41,349 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:41,350 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:41,350 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,350 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,350 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:41,350 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000004 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:41,351 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:41,351 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:41,351 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:41,352 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0008 container=Container: [ContainerId: container_1426266260362_0008_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0008_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,352 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:06:41,352 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:41,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:42,047 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:42,056 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0008_01_000007 by user soberoi
2015-03-13 10:06:42,056 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0008_01_000007 to application application_1426266260362_0008
2015-03-13 10:06:42,056 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:42,056 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:06:42,056 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0008
2015-03-13 10:06:42,056 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0008
2015-03-13 10:06:42,056 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:42,057 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0008
2015-03-13 10:06:42,057 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:42,081 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:42,081 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:42,144 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007/default_container_executor.sh]
2015-03-13 10:06:42,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:42,350 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:43,000 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:43,057 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:06:43,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,003 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:44,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,502 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,559 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61423 dest: /127.0.0.1:60696
2015-03-13 10:06:44,560 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61424 dest: /127.0.0.1:60689
2015-03-13 10:06:44,561 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096 src: /127.0.0.1:61425 dest: /127.0.0.1:60693
2015-03-13 10:06:44,571 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61425, dest: /127.0.0.1:60693, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 8305000
2015-03-13 10:06:44,571 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,571 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,572 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61424, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 8786000
2015-03-13 10:06:44,572 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,572 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,573 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61423, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 9776000
2015-03-13 10:06:44,573 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,573 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741920_1096{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,577 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0008_r_000000_0_1392375621_1
2015-03-13 10:06:44,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0 dst=null perm=null
2015-03-13 10:06:44,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0 dst=null perm=null
2015-03-13 10:06:44,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000 dst=null perm=null
2015-03-13 10:06:44,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/_temporary/attempt_1426266260362_0008_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:44,602 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000007
2015-03-13 10:06:44,602 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:44,602 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:06:44,602 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000007
2015-03-13 10:06:44,603 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:06:44,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,610 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,612 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0008_01_000007 is : 143
2015-03-13 10:06:44,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1 dst=null perm=null
2015-03-13 10:06:44,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:44,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:44,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000 dst=null perm=null
2015-03-13 10:06:44,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2015-03-13 10:06:44,621 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:06:44,621 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:06:44,622 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000007 from application application_1426266260362_0008
2015-03-13 10:06:44,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:44,622 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:44,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,622 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000007
2015-03-13 10:06:44,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary/1/task_1426266260362_0008_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary dst=null perm=null
2015-03-13 10:06:44,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,632 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,635 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,647 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61411, dest: /127.0.0.1:60693, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4708953000
2015-03-13 10:06:44,648 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,648 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,649 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61410, dest: /127.0.0.1:60689, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4709983000
2015-03-13 10:06:44,649 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,650 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,650 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61409, dest: /127.0.0.1:60696, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 4711162000
2015-03-13 10:06:44,650 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,651 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741919_1095{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,652 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,656 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:44,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61426 dest: /127.0.0.1:60689
2015-03-13 10:06:44,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61427 dest: /127.0.0.1:60693
2015-03-13 10:06:44,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097 src: /127.0.0.1:61428 dest: /127.0.0.1:60686
2015-03-13 10:06:44,663 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61428, dest: /127.0.0.1:60686, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 1342000
2015-03-13 10:06:44,663 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,663 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,663 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61427, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 1848000
2015-03-13 10:06:44,664 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,664 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,664 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61426, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 2713000
2015-03-13 10:06:44,664 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,665 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741921_1097{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:44,666 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist dst=null perm=null
2015-03-13 10:06:44,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:44,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist dst=null perm=null
2015-03-13 10:06:44,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:06:44,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1.jhist dst=null perm=null
2015-03-13 10:06:44,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,682 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61429, bytes: 67497, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095, duration: 260000
2015-03-13 10:06:44,684 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,685 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61430 dest: /127.0.0.1:60696
2015-03-13 10:06:44,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61431 dest: /127.0.0.1:60686
2015-03-13 10:06:44,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098 src: /127.0.0.1:61432 dest: /127.0.0.1:60693
2015-03-13 10:06:44,690 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61432, dest: /127.0.0.1:60693, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 1832000
2015-03-13 10:06:44,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,691 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61431, dest: /127.0.0.1:60686, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 2331000
2015-03-13 10:06:44,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,692 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61430, dest: /127.0.0.1:60696, bytes: 66973, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, duration: 3105000
2015-03-13 10:06:44,692 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741922_1098{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,694 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml dst=null perm=null
2015-03-13 10:06:44,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:44,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml dst=null perm=null
2015-03-13 10:06:44,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp dst=null perm=null
2015-03-13 10:06:44,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008/job_1426266260362_0008_1_conf.xml dst=null perm=null
2015-03-13 10:06:44,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:44,707 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61433, bytes: 93975, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741918_1094, duration: 253000
2015-03-13 10:06:44,709 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:44,710 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61434 dest: /127.0.0.1:60686
2015-03-13 10:06:44,712 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61435 dest: /127.0.0.1:60696
2015-03-13 10:06:44,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099 src: /127.0.0.1:61436 dest: /127.0.0.1:60693
2015-03-13 10:06:44,716 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61436, dest: /127.0.0.1:60693, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 1923000
2015-03-13 10:06:44,716 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:44,717 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,717 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61435, dest: /127.0.0.1:60696, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 2636000
2015-03-13 10:06:44,717 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,718 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,718 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61434, dest: /127.0.0.1:60686, bytes: 93243, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-789528504_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, duration: 3371000
2015-03-13 10:06:44,718 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:44,718 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741923_1099{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:44,719 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-789528504_1
2015-03-13 10:06:44,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:06:44,732 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from RUNNING to FINISHING
2015-03-13 10:06:44,732 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0008
2015-03-13 10:06:44,732 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from RUNNING to REMOVING
2015-03-13 10:06:44,732 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0008
2015-03-13 10:06:44,732 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from REMOVING to FINISHING
2015-03-13 10:06:45,003 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:45,603 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:06:45,604 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000007
2015-03-13 10:06:45,604 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:45,604 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:06:45,605 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000007
2015-03-13 10:06:45,605 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:06:45,605 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:06:45,605 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:45,605 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:45,606 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:06:45,606 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:06:45,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741914_1090 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:06:45,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741915_1091 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:06:45,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741916_1092 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:06:45,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741917_1093 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:06:45,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741919_1095 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:06:45,743 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741918_1094 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:06:45,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0008 dst=null perm=null
2015-03-13 10:06:45,748 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093, blk_1073741918_1094]
2015-03-13 10:06:45,749 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741917_1093, blk_1073741919_1095]
2015-03-13 10:06:45,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,778 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary
2015-03-13 10:06:45,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/_temporary dst=null perm=null
2015-03-13 10:06:45,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,786 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,787 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,790 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2015-03-13 10:06:45,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61438, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 149000
2015-03-13 10:06:45,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,800 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,801 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,805 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:45,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:45,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:45,806 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,807 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:45,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2015-03-13 10:06:45,808 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:45,809 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61439, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 165000
2015-03-13 10:06:45,810 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin
2015-03-13 10:06:45,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin dst=null perm=null
2015-03-13 10:06:45,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2015-03-13 10:06:45,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhsswappedjoin/part-00000 dst=null perm=null
2015-03-13 10:06:45,815 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61439, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096, duration: 164000
2015-03-13 10:06:45,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:45,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:06:45,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:06:45,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:06:45,828 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,829 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:06:45,829 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:06:45,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:06:45,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:06:45,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:06:45,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:06:45,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:06:45,861 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:06:45,862 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs"]
2015-03-13 10:06:45,862 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] parallel execution is enabled: true
2015-03-13 10:06:45,862 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting jobs: 2
2015-03-13 10:06:45,862 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] allocating threads: 2
2015-03-13 10:06:45,863 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (2/2)
2015-03-13 10:06:45,871 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,879 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:06:45,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:45,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:45,883 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 9
2015-03-13 10:06:45,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=null
2015-03-13 10:06:45,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:06:45,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:06:45,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:45,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,889 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:45,890 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61441 dest: /127.0.0.1:60696
2015-03-13 10:06:45,891 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61442 dest: /127.0.0.1:60686
2015-03-13 10:06:45,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61443 dest: /127.0.0.1:60693
2015-03-13 10:06:45,896 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61443, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 1803000
2015-03-13 10:06:45,896 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,897 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61442, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 2457000
2015-03-13 10:06:45,897 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,897 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,897 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,897 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61441, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 2902000
2015-03-13 10:06:45,898 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,899 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741924_1100{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,900 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,900 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar
2015-03-13 10:06:45,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:45,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:45,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:45,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:45,905 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:06:45,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:06:45,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:06:45,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:06:45,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:06:45,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:45,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:45,910 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:06:45,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:06:45,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,914 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split
2015-03-13 10:06:45,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:45,916 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:06:45,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61444 dest: /127.0.0.1:60686
2015-03-13 10:06:45,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61445 dest: /127.0.0.1:60689
2015-03-13 10:06:45,920 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61446 dest: /127.0.0.1:60696
2015-03-13 10:06:45,921 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101 src: /127.0.0.1:61447 dest: /127.0.0.1:60693
2015-03-13 10:06:45,924 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61447, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 1620000
2015-03-13 10:06:45,924 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,924 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,924 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61446, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 1900000
2015-03-13 10:06:45,924 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,925 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,925 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61445, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 2582000
2015-03-13 10:06:45,925 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,926 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,926 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61444, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 3676000
2015-03-13 10:06:45,926 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,926 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741925_1101{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:06:45,928 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,931 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:45,933 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61448 dest: /127.0.0.1:60696
2015-03-13 10:06:45,934 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61449 dest: /127.0.0.1:60693
2015-03-13 10:06:45,935 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102 src: /127.0.0.1:61450 dest: /127.0.0.1:60686
2015-03-13 10:06:45,937 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61450, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 1336000
2015-03-13 10:06:45,937 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,938 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,938 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61449, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 1749000
2015-03-13 10:06:45,938 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,938 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,938 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61448, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 2503000
2015-03-13 10:06:45,939 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,939 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741926_1102{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,941 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:06:45,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:06:45,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:06:45,945 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:06:45,946 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:06:45,950 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:45,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61451 dest: /127.0.0.1:60693
2015-03-13 10:06:45,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61452 dest: /127.0.0.1:60696
2015-03-13 10:06:45,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103 src: /127.0.0.1:61453 dest: /127.0.0.1:60686
2015-03-13 10:06:45,956 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61453, dest: /127.0.0.1:60686, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 1504000
2015-03-13 10:06:45,957 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:45,957 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,957 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61452, dest: /127.0.0.1:60696, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 1944000
2015-03-13 10:06:45,958 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,958 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,958 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61451, dest: /127.0.0.1:60693, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 2948000
2015-03-13 10:06:45,958 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:45,960 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741927_1103{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:45,961 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:06:45,961 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0009
2015-03-13 10:06:45,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=null
2015-03-13 10:06:45,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:45,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:45,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:45,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:45,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:45,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:45,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:45,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:45,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:45,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:45,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:45,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:45,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:45,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:45,973 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 9 submitted by user soberoi
2015-03-13 10:06:45,973 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0009
2015-03-13 10:06:45,974 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from NEW to NEW_SAVING
2015-03-13 10:06:45,974 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0009
2015-03-13 10:06:45,973 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0009
2015-03-13 10:06:45,974 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:06:45,974 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0009_000001
2015-03-13 10:06:45,974 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from NEW to SUBMITTED
2015-03-13 10:06:45,974 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0009 from user: soberoi activated in queue: default
2015-03-13 10:06:45,975 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0009 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:06:45,975 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0009 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:06:45,975 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0009 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:06:45,975 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0009_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:06:45,975 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:06:45,975 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from SUBMITTED to ACCEPTED
2015-03-13 10:06:45,977 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0009/
2015-03-13 10:06:45,977 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0009
2015-03-13 10:06:45,977 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0009/
2015-03-13 10:06:45,980 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:45,980 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:45,980 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:45,982 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:46,005 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:46,006 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:46,006 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:06:46,006 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:06:46,006 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0009_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:46,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:06:46,006 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:46,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:46,007 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0009 AttemptId: appattempt_1426266260362_0009_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:06:46,007 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:06:46,007 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,007 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:06:46,007 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0009_000001
2015-03-13 10:06:46,008 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,009 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0009_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:06:46,012 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:46,014 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000001 by user soberoi
2015-03-13 10:06:46,014 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:46,014 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:06:46,014 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:46,014 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000001 to application application_1426266260362_0009
2015-03-13 10:06:46,014 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:46,015 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0009_000001
2015-03-13 10:06:46,015 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:06:46,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:06:46,015 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:46,015 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:46,015 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000001
2015-03-13 10:06:46,025 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0009_01_000001.tokens. Credentials list:
2015-03-13 10:06:46,039 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:46,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0009_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001.tokens
2015-03-13 10:06:46,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:46,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:46,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:46,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:46,176 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61457, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 388000
2015-03-13 10:06:46,184 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:46,184 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,184 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:46,185 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:46,185 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:46,195 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,200 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:46,200 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:46,201 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097
2015-03-13 10:06:46,201 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:46,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:46,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:46,220 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61457, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 172000
2015-03-13 10:06:46,232 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:46,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:46,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:46,255 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61458, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 164000
2015-03-13 10:06:46,267 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:46,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:46,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:46,290 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61458, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1915343812_4952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 280000
2015-03-13 10:06:46,302 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:46,303 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:46,327 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:46,327 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:46,380 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741919_1095
2015-03-13 10:06:46,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741920_1096
2015-03-13 10:06:46,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741923_1099
2015-03-13 10:06:46,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:46,381 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:46,382 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741922_1098
2015-03-13 10:06:46,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001/default_container_executor.sh]
2015-03-13 10:06:46,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:46,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:46,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:46,402 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:46,404 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:46,404 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:46,403 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:46,404 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:46,405 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:46,405 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:47,005 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:47,006 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:47,006 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:47,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:06:48,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED dst=null perm=null
2015-03-13 10:06:48,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:06:48,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_FAIL dst=null perm=null
2015-03-13 10:06:48,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:48,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:48,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=null
2015-03-13 10:06:48,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:06:48,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:06:48,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:48,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.splitmetainfo dst=null perm=null
2015-03-13 10:06:48,400 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61460, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102, duration: 152000
2015-03-13 10:06:48,750 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741924_1100 to datanode(s) 127.0.0.1:60689
2015-03-13 10:06:48,750 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741918_1094, blk_1073741919_1095]
2015-03-13 10:06:48,750 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741914_1090, blk_1073741915_1091, blk_1073741916_1092, blk_1073741917_1093, blk_1073741918_1094, blk_1073741919_1095]
2015-03-13 10:06:49,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:49,010 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:49,225 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:49,227 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0009_000001
2015-03-13 10:06:49,227 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0009 APPATTEMPTID=appattempt_1426266260362_0009_000001
2015-03-13 10:06:49,227 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:06:49,227 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from ACCEPTED to RUNNING
2015-03-13 10:06:49,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:49,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:06:49,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:06:49,458 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:06:49,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61466 dest: /127.0.0.1:60689
2015-03-13 10:06:49,497 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61467 dest: /127.0.0.1:60693
2015-03-13 10:06:49,499 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104 src: /127.0.0.1:61468 dest: /127.0.0.1:60686
2015-03-13 10:06:49,507 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61468, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 6530000
2015-03-13 10:06:49,507 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:06:49,508 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,508 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61467, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 7260000
2015-03-13 10:06:49,509 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:49,509 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61466, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 8196000
2015-03-13 10:06:49,509 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:06:49,509 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,510 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741928_1104{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:06:49,514 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:06:49,570 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:49,570 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:49,570 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917 for deletion
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741917_1093 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741917
2015-03-13 10:06:49,571 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:49,572 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:49,758 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 to 127.0.0.1:60689
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914 for deletion
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915 for deletion
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916 for deletion
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918 for deletion
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741914_1090 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741914
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741916_1092 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741916
2015-03-13 10:06:49,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919 for deletion
2015-03-13 10:06:49,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741915_1091 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741915
2015-03-13 10:06:49,760 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:06:49,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741918_1094 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741918
2015-03-13 10:06:49,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741919_1095 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741919
2015-03-13 10:06:49,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61469 dest: /127.0.0.1:60689
2015-03-13 10:06:49,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100 src: /127.0.0.1:61469 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:06:49,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741924_1100 size 254067
2015-03-13 10:06:50,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:50,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:50,625 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,625 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:06:50,625 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:50,625 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,626 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:06:50,626 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,626 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:06:50,627 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:06:50,627 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,627 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:06:50,627 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,628 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,628 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:06:50,628 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:06:50,628 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,628 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:06:50,628 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,629 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,629 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:06:50,629 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:06:50,629 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0009_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,629 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:06:50,629 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,770 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0008_01_000001 succeeded
2015-03-13 10:06:50,770 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:06:50,771 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,778 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:50,779 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0008_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:06:50,779 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0008_01_000001 from application application_1426266260362_0008
2015-03-13 10:06:50,779 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:50,779 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0008
2015-03-13 10:06:50,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,779 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008/container_1426266260362_0008_01_000001
2015-03-13 10:06:50,810 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741926_1102
2015-03-13 10:06:50,811 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:50,812 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101
2015-03-13 10:06:50,812 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103
2015-03-13 10:06:50,894 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:06:50,894 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:06:50,894 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:06:50,894 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0009 container=Container: [ContainerId: container_1426266260362_0009_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0009_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:50,895 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:06:50,895 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,017 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:51,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 8 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:06:51,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0008_01_000001
2015-03-13 10:06:51,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,020 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0008_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:06:51,020 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0008_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:06:51,020 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0008_000001
2015-03-13 10:06:51,020 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0008 CONTAINERID=container_1426266260362_0008_01_000001
2015-03-13 10:06:51,021 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0008_000001 State change from FINISHING to FINISHED
2015-03-13 10:06:51,021 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0008_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:06:51,021 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0008 State change from FINISHING to FINISHED
2015-03-13 10:06:51,021 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:06:51,021 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0008_000001
2015-03-13 10:06:51,021 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0008
2015-03-13 10:06:51,021 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0008_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,021 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0008,name=[60C5B77597CA4154960349C96889F7F7/B3FE72BB40B045389F47AAE64AC74701] cogrouping/(1/1) ...intocogrouplhsswappedjoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0008/jobhistory/job/job_1426266260362_0008,appMasterHost=Edinburgh.local,startTime=1426266385193,finishTime=1426266404732,finalStatus=SUCCEEDED
2015-03-13 10:06:51,021 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:06:51,022 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:06:51,022 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0008_000001 released container container_1426266260362_0008_01_000001 on node: host: 10.1.1.144:60719 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:06:51,022 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0008_000001 is done. finalState=FINISHED
2015-03-13 10:06:51,022 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0008 requests cleared
2015-03-13 10:06:51,022 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0008 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:06:51,022 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0008 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:06:51,024 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0008_000001 (auth:SIMPLE)
2015-03-13 10:06:51,025 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0008_01_000001
2015-03-13 10:06:51,208 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100
2015-03-13 10:06:51,209 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:51,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,261 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,262 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:06:51,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:51,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:51,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:51,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:51,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:06:51,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:06:51,385 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104
2015-03-13 10:06:51,387 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:51,387 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:06:51,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000002 by user soberoi
2015-03-13 10:06:51,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:51,390 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:06:51,390 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000003 by user soberoi
2015-03-13 10:06:51,391 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:06:51,391 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:51,391 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000002 to application application_1426266260362_0009
2015-03-13 10:06:51,391 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000003 to application application_1426266260362_0009
2015-03-13 10:06:51,391 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:51,392 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,392 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000004 by user soberoi
2015-03-13 10:06:51,392 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,392 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,392 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,392 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,392 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,392 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,392 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,393 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,393 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,393 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,393 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,393 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000004 to application application_1426266260362_0009
2015-03-13 10:06:51,393 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000003
2015-03-13 10:06:51,391 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000006 by user soberoi
2015-03-13 10:06:51,394 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0009_01_000005 by user soberoi
2015-03-13 10:06:51,394 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000002
2015-03-13 10:06:51,392 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:06:51,394 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:06:51,394 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0009
2015-03-13 10:06:51,395 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:06:51,396 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,396 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000005 to application application_1426266260362_0009
2015-03-13 10:06:51,396 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,396 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,396 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,396 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,397 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000004
2015-03-13 10:06:51,397 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from NEW to INITING
2015-03-13 10:06:51,397 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0009_01_000006 to application application_1426266260362_0009
2015-03-13 10:06:51,397 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from INITING to RUNNING
2015-03-13 10:06:51,398 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:06:51,398 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,398 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,398 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,398 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,398 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,398 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:06:51,398 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000006
2015-03-13 10:06:51,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,399 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0009
2015-03-13 10:06:51,399 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:06:51,399 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0009
2015-03-13 10:06:51,399 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0009_01_000005
2015-03-13 10:06:51,420 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000003.tokens. Credentials list:
2015-03-13 10:06:51,423 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0009_01_000002.tokens. Credentials list:
2015-03-13 10:06:51,427 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000004.tokens. Credentials list:
2015-03-13 10:06:51,427 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0009_01_000006.tokens. Credentials list:
2015-03-13 10:06:51,428 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000005.tokens. Credentials list:
2015-03-13 10:06:51,441 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:51,446 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:51,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003.tokens
2015-03-13 10:06:51,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:51,523 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0009_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006.tokens
2015-03-13 10:06:51,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:51,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar dst=null perm=null
2015-03-13 10:06:51,606 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61477, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_873968378_5098, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 522000
2015-03-13 10:06:51,608 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61478, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_766654705_5101, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741924_1100, duration: 472000
2015-03-13 10:06:51,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,627 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:51,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,627 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0008
2015-03-13 10:06:51,628 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:51,628 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0008, with delay of 10800 seconds
2015-03-13 10:06:51,627 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:51,628 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,629 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,629 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:51,632 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,633 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml dst=null perm=null
2015-03-13 10:06:51,663 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61479, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_766654705_5101, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 297000
2015-03-13 10:06:51,663 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61480, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_873968378_5098, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741927_1103, duration: 285000
2015-03-13 10:06:51,677 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,677 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:06:51,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:06:51,727 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,727 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,728 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,728 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,728 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,737 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:06:51,737 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:06:51,869 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003/default_container_executor.sh]
2015-03-13 10:06:51,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005/default_container_executor.sh]
2015-03-13 10:06:51,873 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006/default_container_executor.sh]
2015-03-13 10:06:51,881 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004/default_container_executor.sh]
2015-03-13 10:06:51,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002/default_container_executor.sh]
2015-03-13 10:06:51,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:51,897 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:06:52,023 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,024 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:06:52,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0008
2015-03-13 10:06:52,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0008
2015-03-13 10:06:52,024 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0008 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:06:52,025 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0008, with delay of 10800 seconds
2015-03-13 10:06:52,281 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:06:52,632 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,708 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:52,846 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005.tokens
2015-03-13 10:06:52,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:52,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:52,957 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:53,026 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0009_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004.tokens
2015-03-13 10:06:53,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:53,176 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:06:53,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0009_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002.tokens
2015-03-13 10:06:53,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:06:53,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:53,904 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,029 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:54,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,031 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:55,910 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,037 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,648 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:56,912 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,649 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,650 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,650 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:57,918 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,045 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:58,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:59,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,653 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:59,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:59,848 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61492, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 167000
2015-03-13 10:06:59,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:59,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job.split dst=null perm=null
2015-03-13 10:06:59,925 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:06:59,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61495, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 166000
2015-03-13 10:06:59,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61496, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 121000
2015-03-13 10:07:00,000 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61497, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 156000
2015-03-13 10:07:00,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61498, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741925_1101, duration: 172000
2015-03-13 10:07:00,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:00,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:00,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61496, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:07:00,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:00,082 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61499, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 231000
2015-03-13 10:07:00,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:00,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:00,125 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61500, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:07:00,129 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61497, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 161000
2015-03-13 10:07:00,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:00,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61501, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:07:00,502 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61502, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 196000
2015-03-13 10:07:00,528 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61503 dest: /127.0.0.1:60696
2015-03-13 10:07:00,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61504 dest: /127.0.0.1:60686
2015-03-13 10:07:00,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,571 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105 src: /127.0.0.1:61505 dest: /127.0.0.1:60689
2015-03-13 10:07:00,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,578 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61505, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 5379000
2015-03-13 10:07:00,579 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 167000
2015-03-13 10:07:00,579 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,580 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61504, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 6464000
2015-03-13 10:07:00,580 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,581 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61503, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 7733000
2015-03-13 10:07:00,581 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,582 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741929_1105{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,590 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0009_m_000000_0_154459683_1
2015-03-13 10:07:00,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0 dst=null perm=null
2015-03-13 10:07:00,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0 dst=null perm=null
2015-03-13 10:07:00,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000 dst=null perm=null
2015-03-13 10:07:00,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000000_0 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,621 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61507, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 163000
2015-03-13 10:07:00,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,631 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,639 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,639 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000002
2015-03-13 10:07:00,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,652 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000002 is : 143
2015-03-13 10:07:00,655 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:00,657 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61509 dest: /127.0.0.1:60686
2015-03-13 10:07:00,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61510 dest: /127.0.0.1:60689
2015-03-13 10:07:00,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107 src: /127.0.0.1:61511 dest: /127.0.0.1:60693
2015-03-13 10:07:00,664 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist for DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:00,665 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,665 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,666 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,666 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000002 from application application_1426266260362_0009
2015-03-13 10:07:00,666 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,666 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,666 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,666 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000002
2015-03-13 10:07:00,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,681 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:00,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,689 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61513, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 154000
2015-03-13 10:07:00,691 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61508 dest: /127.0.0.1:60693
2015-03-13 10:07:00,692 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61514 dest: /127.0.0.1:60696
2015-03-13 10:07:00,694 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106 src: /127.0.0.1:61515 dest: /127.0.0.1:60689
2015-03-13 10:07:00,702 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61515, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 6417000
2015-03-13 10:07:00,702 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,703 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,703 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61514, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 7430000
2015-03-13 10:07:00,703 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,704 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61508, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 8271000
2015-03-13 10:07:00,704 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,704 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,705 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741930_1106{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,710 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0009_m_000003_0_1185482097_1
2015-03-13 10:07:00,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0 dst=null perm=null
2015-03-13 10:07:00,724 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:00,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61512 dest: /127.0.0.1:60689
2015-03-13 10:07:00,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0 dst=null perm=null
2015-03-13 10:07:00,727 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61516 dest: /127.0.0.1:60693
2015-03-13 10:07:00,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003 dst=null perm=null
2015-03-13 10:07:00,728 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108 src: /127.0.0.1:61517 dest: /127.0.0.1:60686
2015-03-13 10:07:00,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000003_0 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,737 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61517, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 7599000
2015-03-13 10:07:00,737 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,738 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,738 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61516, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 8302000
2015-03-13 10:07:00,738 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,738 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,739 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61512, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 9165000
2015-03-13 10:07:00,739 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,739 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741932_1108{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:00,745 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0009_m_000002_0_-1960666537_1
2015-03-13 10:07:00,749 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000005
2015-03-13 10:07:00,749 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,749 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000002
2015-03-13 10:07:00,750 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000005
2015-03-13 10:07:00,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,751 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,751 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,751 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000002
2015-03-13 10:07:00,751 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:00,751 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:00,751 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,751 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,751 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:00,752 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000002 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:00,764 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000005 is : 143
2015-03-13 10:07:00,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0 dst=null perm=null
2015-03-13 10:07:00,776 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,778 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,778 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000005 from application application_1426266260362_0009
2015-03-13 10:07:00,778 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,778 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0 dst=null perm=null
2015-03-13 10:07:00,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002 dst=null perm=null
2015-03-13 10:07:00,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61518 dest: /127.0.0.1:60696
2015-03-13 10:07:00,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61519 dest: /127.0.0.1:60686
2015-03-13 10:07:00,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000002_0 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109 src: /127.0.0.1:61520 dest: /127.0.0.1:60693
2015-03-13 10:07:00,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,793 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61520, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 6175000
2015-03-13 10:07:00,794 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,794 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,794 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61519, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 6813000
2015-03-13 10:07:00,794 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,795 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61518, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 7620000
2015-03-13 10:07:00,795 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:00,795 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741933_1109{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:00,798 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000004
2015-03-13 10:07:00,798 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,798 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,799 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000004
2015-03-13 10:07:00,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:00,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000005
2015-03-13 10:07:00,800 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,800 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,800 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000005
2015-03-13 10:07:00,800 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61521, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 154000
2015-03-13 10:07:00,800 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:00,800 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:00,801 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,801 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,801 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:00,801 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:00,807 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0009_m_000001_0_30834488_1
2015-03-13 10:07:00,812 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000004 is : 143
2015-03-13 10:07:00,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0 dst=null perm=null
2015-03-13 10:07:00,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0 dst=null perm=null
2015-03-13 10:07:00,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001 dst=null perm=null
2015-03-13 10:07:00,825 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,825 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,826 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000004
2015-03-13 10:07:00,827 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,827 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,827 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000004 from application application_1426266260362_0009
2015-03-13 10:07:00,827 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,828 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,828 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:00,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000001_0 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:00,841 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000003
2015-03-13 10:07:00,841 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:00,841 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:00,842 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:00,842 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000004
2015-03-13 10:07:00,842 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:00,842 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000003
2015-03-13 10:07:00,842 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:00,842 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:00,842 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000004
2015-03-13 10:07:00,842 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:00,843 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:00,843 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,843 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:00,843 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:00,844 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:00,856 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000003 is : 143
2015-03-13 10:07:00,870 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:00,870 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,871 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000003
2015-03-13 10:07:00,873 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:00,873 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:00,873 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000003 from application application_1426266260362_0009
2015-03-13 10:07:00,873 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:00,873 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:00,876 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61522 dest: /127.0.0.1:60693
2015-03-13 10:07:00,877 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61523 dest: /127.0.0.1:60686
2015-03-13 10:07:00,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110 src: /127.0.0.1:61524 dest: /127.0.0.1:60689
2015-03-13 10:07:00,885 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61524, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 5196000
2015-03-13 10:07:00,885 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:00,885 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,886 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61523, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 5792000
2015-03-13 10:07:00,886 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,886 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61522, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 6537000
2015-03-13 10:07:00,887 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:00,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741934_1110{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:00,890 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0009_m_000004_0_-1714208805_1
2015-03-13 10:07:00,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0 dst=null perm=null
2015-03-13 10:07:00,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:01,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,023 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,052 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:01,215 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,216 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,216 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,216 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,396 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110
2015-03-13 10:07:01,396 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106
2015-03-13 10:07:01,396 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108
2015-03-13 10:07:01,396 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,397 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105
2015-03-13 10:07:01,397 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,397 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109
2015-03-13 10:07:01,847 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:01,847 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000003
2015-03-13 10:07:01,848 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:01,848 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:01,848 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000003
2015-03-13 10:07:01,848 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:01,849 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:01,849 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:01,849 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:01,849 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:01,849 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:01,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0 dst=null perm=null
2015-03-13 10:07:01,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004 dst=null perm=null
2015-03-13 10:07:01,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/_temporary/attempt_1426266260362_0009_m_000004_0 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:01,928 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:07:01,929 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:01,929 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000006
2015-03-13 10:07:01,929 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:01,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,935 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1 dst=null perm=null
2015-03-13 10:07:01,938 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0009_01_000006 is : 143
2015-03-13 10:07:01,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000 dst=null perm=null
2015-03-13 10:07:01,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 dst=null perm=null
2015-03-13 10:07:01,948 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:01,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,948 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:01,949 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:01,949 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000006 from application application_1426266260362_0009
2015-03-13 10:07:01,949 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:01,949 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:01,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000000/part-00000 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,948 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,949 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000006
2015-03-13 10:07:01,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001 dst=null perm=null
2015-03-13 10:07:01,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 dst=null perm=null
2015-03-13 10:07:01,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000001/part-00001 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002 dst=null perm=null
2015-03-13 10:07:01,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 dst=null perm=null
2015-03-13 10:07:01,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000002/part-00002 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003 dst=null perm=null
2015-03-13 10:07:01,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 dst=null perm=null
2015-03-13 10:07:01,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000003/part-00003 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:01,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004 dst=null perm=null
2015-03-13 10:07:01,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 dst=null perm=null
2015-03-13 10:07:01,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary/1/task_1426266260362_0009_m_000004/part-00004 dst=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_temporary dst=null perm=null
2015-03-13 10:07:01,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,978 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/_SUCCESS is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:01,981 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,991 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61511, dest: /127.0.0.1:60693, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1329613000
2015-03-13 10:07:01,992 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:01,992 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,993 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61510, dest: /127.0.0.1:60689, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1330707000
2015-03-13 10:07:01,993 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:01,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,994 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61509, dest: /127.0.0.1:60686, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 1332049000
2015-03-13 10:07:01,994 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:01,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741931_1107{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:01,996 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:01,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,000 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:02,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61526 dest: /127.0.0.1:60686
2015-03-13 10:07:02,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61527 dest: /127.0.0.1:60689
2015-03-13 10:07:02,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111 src: /127.0.0.1:61528 dest: /127.0.0.1:60696
2015-03-13 10:07:02,008 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61528, dest: /127.0.0.1:60696, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 1215000
2015-03-13 10:07:02,008 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,008 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,008 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61527, dest: /127.0.0.1:60689, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 2032000
2015-03-13 10:07:02,009 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,009 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,009 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61526, dest: /127.0.0.1:60686, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 2919000
2015-03-13 10:07:02,009 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,010 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741935_1111{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,011 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist dst=null perm=null
2015-03-13 10:07:02,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:02,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist dst=null perm=null
2015-03-13 10:07:02,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:02,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1.jhist dst=null perm=null
2015-03-13 10:07:02,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,030 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61529, bytes: 53754, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107, duration: 209000
2015-03-13 10:07:02,032 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:02,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61530 dest: /127.0.0.1:60689
2015-03-13 10:07:02,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61531 dest: /127.0.0.1:60693
2015-03-13 10:07:02,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112 src: /127.0.0.1:61532 dest: /127.0.0.1:60686
2015-03-13 10:07:02,038 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61532, dest: /127.0.0.1:60686, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 1674000
2015-03-13 10:07:02,038 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,039 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61531, dest: /127.0.0.1:60693, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 2242000
2015-03-13 10:07:02,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,040 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61530, dest: /127.0.0.1:60689, bytes: 53334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, duration: 2861000
2015-03-13 10:07:02,040 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741936_1112{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:02,041 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml dst=null perm=null
2015-03-13 10:07:02,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:02,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml dst=null perm=null
2015-03-13 10:07:02,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:02,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009/job_1426266260362_0009_1_conf.xml dst=null perm=null
2015-03-13 10:07:02,050 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:02,052 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61529, bytes: 91486, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741928_1104, duration: 263000
2015-03-13 10:07:02,054 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:02,054 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:02,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61533 dest: /127.0.0.1:60693
2015-03-13 10:07:02,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61534 dest: /127.0.0.1:60686
2015-03-13 10:07:02,059 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113 src: /127.0.0.1:61535 dest: /127.0.0.1:60696
2015-03-13 10:07:02,062 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61535, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 2037000
2015-03-13 10:07:02,062 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:02,063 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,063 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61534, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 2630000
2015-03-13 10:07:02,063 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,063 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,064 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61533, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_634066759_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, duration: 3474000
2015-03-13 10:07:02,064 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:02,064 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741937_1113{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:02,065 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_634066759_1
2015-03-13 10:07:02,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:02,078 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:02,078 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0009
2015-03-13 10:07:02,078 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from RUNNING to REMOVING
2015-03-13 10:07:02,078 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0009
2015-03-13 10:07:02,078 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from REMOVING to FINISHING
2015-03-13 10:07:02,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:02,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000006
2015-03-13 10:07:02,931 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:02,931 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:02,932 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000006
2015-03-13 10:07:02,932 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:02,932 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:02,933 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:02,933 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:02,933 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:02,933 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:03,058 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:03,088 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741924_1100 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:07:03,088 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741925_1101 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:07:03,088 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741926_1102 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:07:03,088 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741927_1103 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:07:03,088 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741931_1107 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:07:03,089 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741928_1104 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:07:03,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0009 dst=null perm=null
2015-03-13 10:07:03,122 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouplhs
2015-03-13 10:07:03,130 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,139 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:03,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:03,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:03,145 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 10
2015-03-13 10:07:03,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=null
2015-03-13 10:07:03,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:03,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:07:03,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:03,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,151 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,153 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61538 dest: /127.0.0.1:60696
2015-03-13 10:07:03,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61539 dest: /127.0.0.1:60689
2015-03-13 10:07:03,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61540 dest: /127.0.0.1:60686
2015-03-13 10:07:03,159 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61540, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 1875000
2015-03-13 10:07:03,159 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,159 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61539, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 2603000
2015-03-13 10:07:03,159 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,160 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,160 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61538, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 3361000
2015-03-13 10:07:03,160 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,161 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741938_1114{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,162 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,163 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar
2015-03-13 10:07:03,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:03,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:03,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:03,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:03,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:07:03,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:07:03,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:07:03,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:07:03,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:07:03,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:03,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:03,173 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:03,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:03,175 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:03,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:03,177 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:03,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:03,178 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:03,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:03,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,182 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split
2015-03-13 10:07:03,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:03,183 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61541 dest: /127.0.0.1:60693
2015-03-13 10:07:03,186 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61542 dest: /127.0.0.1:60696
2015-03-13 10:07:03,187 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61543 dest: /127.0.0.1:60689
2015-03-13 10:07:03,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115 src: /127.0.0.1:61544 dest: /127.0.0.1:60686
2015-03-13 10:07:03,190 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61544, dest: /127.0.0.1:60686, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 1553000
2015-03-13 10:07:03,190 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,191 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61543, dest: /127.0.0.1:60689, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 1940000
2015-03-13 10:07:03,191 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,192 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61542, dest: /127.0.0.1:60696, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 2448000
2015-03-13 10:07:03,192 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,192 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61541, dest: /127.0.0.1:60693, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 3511000
2015-03-13 10:07:03,192 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,193 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,193 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741939_1115{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,197 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,201 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,203 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61545 dest: /127.0.0.1:60696
2015-03-13 10:07:03,204 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61546 dest: /127.0.0.1:60689
2015-03-13 10:07:03,205 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116 src: /127.0.0.1:61547 dest: /127.0.0.1:60686
2015-03-13 10:07:03,208 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61547, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 1067000
2015-03-13 10:07:03,208 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,208 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,209 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61546, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 1605000
2015-03-13 10:07:03,209 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,209 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,209 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61545, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 2345000
2015-03-13 10:07:03,210 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,211 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741940_1116{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,211 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,212 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:03,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:03,216 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:03,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:03,217 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:03,234 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:03,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61548 dest: /127.0.0.1:60693
2015-03-13 10:07:03,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61549 dest: /127.0.0.1:60689
2015-03-13 10:07:03,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117 src: /127.0.0.1:61550 dest: /127.0.0.1:60686
2015-03-13 10:07:03,240 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61550, dest: /127.0.0.1:60686, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 1642000
2015-03-13 10:07:03,240 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:03,241 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,241 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61549, dest: /127.0.0.1:60689, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 2134000
2015-03-13 10:07:03,241 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,241 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,242 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61548, dest: /127.0.0.1:60693, bytes: 100395, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 2814000
2015-03-13 10:07:03,242 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:03,243 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741941_1117{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:03,244 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:03,245 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0010
2015-03-13 10:07:03,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=null
2015-03-13 10:07:03,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:03,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:03,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:03,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:03,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:03,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:03,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:03,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:03,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:03,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:03,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:03,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:03,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:03,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:03,259 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 10 submitted by user soberoi
2015-03-13 10:07:03,259 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0010
2015-03-13 10:07:03,259 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0010
2015-03-13 10:07:03,259 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0010
2015-03-13 10:07:03,259 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from NEW to NEW_SAVING
2015-03-13 10:07:03,259 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:03,259 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,260 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:03,260 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0010 from user: soberoi activated in queue: default
2015-03-13 10:07:03,260 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0010 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:03,260 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0010 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:03,260 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0010 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:03,260 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0010_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:03,260 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:03,262 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:03,263 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0010/
2015-03-13 10:07:03,263 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0010
2015-03-13 10:07:03,263 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0010/
2015-03-13 10:07:03,761 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741938_1114 to datanode(s) 127.0.0.1:60693
2015-03-13 10:07:03,761 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:03,761 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:03,850 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:03,850 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:03,850 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:07:03,850 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:03,850 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:03,850 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:03,851 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:03,852 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0010 AttemptId: appattempt_1426266260362_0010_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:07:03,852 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:03,852 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,852 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:03,852 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0010_000001
2015-03-13 10:07:03,853 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,853 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0010_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:07:03,855 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:03,856 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000001 by user soberoi
2015-03-13 10:07:03,857 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:03,857 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:03,857 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:03,857 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000001 to application application_1426266260362_0010
2015-03-13 10:07:03,857 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:03,857 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0010_000001
2015-03-13 10:07:03,858 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:03,858 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:03,858 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:03,858 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,858 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:03,859 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000001
2015-03-13 10:07:03,867 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0010_01_000001.tokens. Credentials list:
2015-03-13 10:07:03,882 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:03,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0010_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001.tokens
2015-03-13 10:07:03,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:04,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:04,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:04,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:04,018 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61554, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 475000
2015-03-13 10:07:04,035 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:04,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:04,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:04,060 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 177000
2015-03-13 10:07:04,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:04,073 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:04,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:04,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:04,096 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 1788, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 154000
2015-03-13 10:07:04,108 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:04,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:04,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:04,130 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61555, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1107403650_5504, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 282000
2015-03-13 10:07:04,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:04,143 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:04,168 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:04,168 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:04,236 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001/default_container_executor.sh]
2015-03-13 10:07:04,416 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:04,416 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 to 127.0.0.1:60693
2015-03-13 10:07:04,416 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:04,416 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:04,416 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:04,418 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:04,418 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:04,418 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:04,418 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:04,418 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:07:04,419 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:04,417 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:04,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61556 dest: /127.0.0.1:60693
2015-03-13 10:07:04,419 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:04,420 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114 src: /127.0.0.1:61556 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:07:04,421 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741938_1114 size 254067
2015-03-13 10:07:04,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:04,855 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:05,063 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:05,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:05,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED dst=null perm=null
2015-03-13 10:07:05,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:07:05,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_FAIL dst=null perm=null
2015-03-13 10:07:05,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:05,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=null
2015-03-13 10:07:05,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:07:05,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:07:06,030 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,031 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,031 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,032 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741931_1107
2015-03-13 10:07:06,066 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:06,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:06,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:06,221 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,234 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,235 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,243 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61558, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116, duration: 173000
2015-03-13 10:07:06,400 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,401 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,402 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,402 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,402 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114
2015-03-13 10:07:06,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741940_1116
2015-03-13 10:07:06,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115
2015-03-13 10:07:06,421 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,422 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,604 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117
2015-03-13 10:07:06,604 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,605 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741936_1112
2015-03-13 10:07:06,605 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741937_1113
2015-03-13 10:07:06,606 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111
2015-03-13 10:07:06,762 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103]
2015-03-13 10:07:06,762 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741924_1100, blk_1073741925_1101, blk_1073741926_1102, blk_1073741927_1103, blk_1073741928_1104, blk_1073741931_1107]
2015-03-13 10:07:06,859 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:07,013 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:07,014 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0010_000001
2015-03-13 10:07:07,014 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0010 APPATTEMPTID=appattempt_1426266260362_0010_000001
2015-03-13 10:07:07,015 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:07,015 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from ACCEPTED to RUNNING
2015-03-13 10:07:07,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:07,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:07,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:07,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:07,220 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:07,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61564 dest: /127.0.0.1:60696
2015-03-13 10:07:07,267 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61565 dest: /127.0.0.1:60686
2015-03-13 10:07:07,269 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118 src: /127.0.0.1:61566 dest: /127.0.0.1:60689
2015-03-13 10:07:07,277 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61566, dest: /127.0.0.1:60689, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 6080000
2015-03-13 10:07:07,277 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:07,278 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61565, dest: /127.0.0.1:60686, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 7151000
2015-03-13 10:07:07,278 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:07,279 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,280 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61564, dest: /127.0.0.1:60696, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 8801000
2015-03-13 10:07:07,280 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:07,281 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,282 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741942_1118{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:07,285 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931 for deletion
2015-03-13 10:07:07,581 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:07,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:07,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:07,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:07,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741928_1104 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741928
2015-03-13 10:07:07,582 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741931_1107 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741931
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924 for deletion
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925 for deletion
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926 for deletion
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741924_1100 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741924
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927 for deletion
2015-03-13 10:07:07,771 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741925_1101 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741925
2015-03-13 10:07:07,772 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741926_1102 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741926
2015-03-13 10:07:07,772 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741927_1103 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741927
2015-03-13 10:07:07,860 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,073 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,074 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,074 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:08,074 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:08,075 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0010_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,075 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:08,075 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,076 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,076 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:08,076 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:07:08,076 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0010_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,076 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:08,077 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,223 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0009_01_000001 succeeded
2015-03-13 10:07:08,224 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:08,224 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009/container_1426266260362_0009_01_000001
2015-03-13 10:07:08,232 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:07:08,233 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0009_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:08,233 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0009_01_000001 from application application_1426266260362_0009
2015-03-13 10:07:08,233 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:08,233 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0009
2015-03-13 10:07:08,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:08,863 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,863 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:08,863 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:08,863 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,864 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:08,864 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,864 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,865 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:08,865 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:07:08,865 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,865 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:08,865 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,949 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:08,950 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:08,950 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:08,950 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0010_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:08,950 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:08,950 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,049 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,049 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:09,075 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 9 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:09,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,075 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0009_01_000001
2015-03-13 10:07:09,075 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0009_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:09,075 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0009_000001
2015-03-13 10:07:09,075 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0009_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:09,076 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0009 CONTAINERID=container_1426266260362_0009_01_000001
2015-03-13 10:07:09,076 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0009_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:09,076 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0009_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:09,076 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:09,076 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0009 State change from FINISHING to FINISHED
2015-03-13 10:07:09,076 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0009_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,076 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0009
2015-03-13 10:07:09,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,076 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0009,name=[E808F612428A4495876D015977ED92F6/A1D84621FEBB4086ADCD0292D5B55714] cogrouping/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0009/jobhistory/job/job_1426266260362_0009,appMasterHost=Edinburgh.local,startTime=1426266405973,finishTime=1426266422078,finalStatus=SUCCEEDED
2015-03-13 10:07:09,076 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0009_000001
2015-03-13 10:07:09,076 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:09,077 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:09,077 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0009_000001 released container container_1426266260362_0009_01_000001 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:09,077 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0009_000001 is done. finalState=FINISHED
2015-03-13 10:07:09,077 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0009 requests cleared
2015-03-13 10:07:09,077 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0009 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:09,077 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0009 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:09,081 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0009_000001 (auth:SIMPLE)
2015-03-13 10:07:09,082 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0009_01_000001
2015-03-13 10:07:09,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:09,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:09,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:09,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:09,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:09,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:09,178 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,178 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,178 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:09,181 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000003 by user soberoi
2015-03-13 10:07:09,181 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:09,181 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:09,181 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000005 by user soberoi
2015-03-13 10:07:09,182 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:09,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:09,182 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000002 by user soberoi
2015-03-13 10:07:09,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:09,183 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000006 by user soberoi
2015-03-13 10:07:09,183 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0010
2015-03-13 10:07:09,182 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000005 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:09,183 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,183 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,182 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000003 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000002 to application application_1426266260362_0010
2015-03-13 10:07:09,183 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,184 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,183 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from NEW to INITING
2015-03-13 10:07:09,184 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,184 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:09,184 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,184 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,184 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000006 to application application_1426266260362_0010
2015-03-13 10:07:09,185 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from INITING to RUNNING
2015-03-13 10:07:09,185 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,184 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,185 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,185 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,185 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,186 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000006
2015-03-13 10:07:09,185 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:09,186 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,187 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,187 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,187 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,187 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000002
2015-03-13 10:07:09,187 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000004 by user soberoi
2015-03-13 10:07:09,187 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:09,188 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000004 to application application_1426266260362_0010
2015-03-13 10:07:09,188 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:09,188 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,188 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:09,188 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:09,188 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:09,189 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,189 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0010_01_000003
2015-03-13 10:07:09,210 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0010_01_000006.tokens. Credentials list:
2015-03-13 10:07:09,211 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0010_01_000002.tokens. Credentials list:
2015-03-13 10:07:09,213 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0010_01_000003.tokens. Credentials list:
2015-03-13 10:07:09,234 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,234 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,239 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,239 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:09,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:09,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0010_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002.tokens
2015-03-13 10:07:09,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:09,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0010_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006.tokens
2015-03-13 10:07:09,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:09,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004/default_container_executor.sh]
2015-03-13 10:07:09,365 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005/default_container_executor.sh]
2015-03-13 10:07:09,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar dst=null perm=null
2015-03-13 10:07:09,477 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61575, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_684912219_5690, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 511000
2015-03-13 10:07:09,477 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61576, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1423446636_5689, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741938_1114, duration: 590000
2015-03-13 10:07:09,505 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,506 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml dst=null perm=null
2015-03-13 10:07:09,549 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61577, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_684912219_5690, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 267000
2015-03-13 10:07:09,556 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61576, bytes: 101183, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1423446636_5689, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741941_1117, duration: 264000
2015-03-13 10:07:09,569 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,569 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,569 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,575 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:09,575 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:09,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,622 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,630 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,630 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:09,630 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,630 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:09,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003/default_container_executor.sh]
2015-03-13 10:07:09,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006/default_container_executor.sh]
2015-03-13 10:07:09,771 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002/default_container_executor.sh]
2015-03-13 10:07:09,864 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,864 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,864 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,865 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:09,865 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,865 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,865 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:09,865 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:09,865 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:09,866 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,865 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,950 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:09,951 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:09,951 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:09,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:09,951 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:09,951 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:09,951 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:09,952 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,065 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:07:10,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,077 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:10,077 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:10,077 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:10,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,078 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0009
2015-03-13 10:07:10,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,078 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0009 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:10,078 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0009, with delay of 10800 seconds
2015-03-13 10:07:10,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0009
2015-03-13 10:07:10,601 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:10,741 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0010_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003.tokens
2015-03-13 10:07:10,741 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:10,870 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,870 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,870 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:10,955 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,083 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,083 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,431 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,607 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,609 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118
2015-03-13 10:07:11,876 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,876 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,876 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:11,956 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,086 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,086 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:12,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,887 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:13,961 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,892 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,892 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,893 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:14,962 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,101 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,101 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:15,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,901 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:16,970 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,108 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,108 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:17,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:17,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61586, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000003_0_411470128_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 161000
2015-03-13 10:07:17,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:17,543 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61587, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 150000
2015-03-13 10:07:17,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:17,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job.split dst=null perm=null
2015-03-13 10:07:17,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:17,662 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61592, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000003_0_411470128_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 155000
2015-03-13 10:07:17,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61591, bytes: 1272, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000002_0_816705034_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 172000
2015-03-13 10:07:17,716 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61593, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 157000
2015-03-13 10:07:17,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:17,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61594, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000004_0_730506202_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741939_1115, duration: 159000
2015-03-13 10:07:17,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:17,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:17,851 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61595, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 142000
2015-03-13 10:07:17,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,907 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:17,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:17,915 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61594, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000004_0_730506202_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 166000
2015-03-13 10:07:17,973 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000003_0 dst=null perm=null
2015-03-13 10:07:18,221 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000005
2015-03-13 10:07:18,221 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,221 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,222 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000005
2015-03-13 10:07:18,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,234 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000005 is : 143
2015-03-13 10:07:18,236 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:18,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61596 dest: /127.0.0.1:60689
2015-03-13 10:07:18,239 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61597 dest: /127.0.0.1:60696
2015-03-13 10:07:18,240 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119 src: /127.0.0.1:61598 dest: /127.0.0.1:60686
2015-03-13 10:07:18,244 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist for DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:18,247 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,248 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,248 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000005 from application application_1426266260362_0010
2015-03-13 10:07:18,248 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,249 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000005
2015-03-13 10:07:18,248 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,325 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61591, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000002_0_816705034_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 160000
2015-03-13 10:07:18,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 dst=null perm=null
2015-03-13 10:07:18,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 dst=null perm=null
2015-03-13 10:07:18,349 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61599, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 154000
2015-03-13 10:07:18,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 dst=null perm=null
2015-03-13 10:07:18,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 dst=null perm=null
2015-03-13 10:07:18,364 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 158000
2015-03-13 10:07:18,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 dst=null perm=null
2015-03-13 10:07:18,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 dst=null perm=null
2015-03-13 10:07:18,370 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61599, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 168000
2015-03-13 10:07:18,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 dst=null perm=null
2015-03-13 10:07:18,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000002_0 dst=null perm=null
2015-03-13 10:07:18,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 dst=null perm=null
2015-03-13 10:07:18,375 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 125000
2015-03-13 10:07:18,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 dst=null perm=null
2015-03-13 10:07:18,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 dst=null perm=null
2015-03-13 10:07:18,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61587, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 157000
2015-03-13 10:07:18,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61600, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000000_0_483516617_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 159000
2015-03-13 10:07:18,396 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000004
2015-03-13 10:07:18,396 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:18,396 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,396 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,396 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000004
2015-03-13 10:07:18,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:18,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000005
2015-03-13 10:07:18,397 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:18,397 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:18,397 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000005
2015-03-13 10:07:18,398 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:07:18,398 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:18,398 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,398 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,398 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:18,398 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:18,410 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000004 is : 143
2015-03-13 10:07:18,422 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000004
2015-03-13 10:07:18,423 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:18,424 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,424 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000004 from application application_1426266260362_0010
2015-03-13 10:07:18,424 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,424 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000000_0 dst=null perm=null
2015-03-13 10:07:18,437 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,437 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000002
2015-03-13 10:07:18,437 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,437 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:18,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,450 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000002 is : 143
2015-03-13 10:07:18,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:18,462 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,463 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,463 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,463 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000002 from application application_1426266260362_0010
2015-03-13 10:07:18,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,465 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,464 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,465 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,464 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000002
2015-03-13 10:07:18,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000004_0 dst=null perm=null
2015-03-13 10:07:18,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 dst=null perm=null
2015-03-13 10:07:18,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00000 dst=null perm=null
2015-03-13 10:07:18,508 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61601, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741929_1105, duration: 182000
2015-03-13 10:07:18,511 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000006
2015-03-13 10:07:18,511 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:18,511 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,511 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000006
2015-03-13 10:07:18,512 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 dst=null perm=null
2015-03-13 10:07:18,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00001 dst=null perm=null
2015-03-13 10:07:18,523 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000006 is : 143
2015-03-13 10:07:18,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61601, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741933_1109, duration: 169000
2015-03-13 10:07:18,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 dst=null perm=null
2015-03-13 10:07:18,536 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00002 dst=null perm=null
2015-03-13 10:07:18,537 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,537 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,537 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,538 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:18,538 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,538 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000006 from application application_1426266260362_0010
2015-03-13 10:07:18,538 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,538 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:18,538 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000006
2015-03-13 10:07:18,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61593, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741932_1108, duration: 172000
2015-03-13 10:07:18,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 dst=null perm=null
2015-03-13 10:07:18,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00003 dst=null perm=null
2015-03-13 10:07:18,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61602, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741930_1106, duration: 169000
2015-03-13 10:07:18,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 dst=null perm=null
2015-03-13 10:07:18,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177/part-00004 dst=null perm=null
2015-03-13 10:07:18,554 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61603, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0010_m_000001_0_-244765215_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741934_1110, duration: 127000
2015-03-13 10:07:18,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_m_000001_0 dst=null perm=null
2015-03-13 10:07:18,584 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000003
2015-03-13 10:07:18,584 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:18,585 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:18,585 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000003
2015-03-13 10:07:18,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:18,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000002
2015-03-13 10:07:18,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:18,586 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:18,586 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:18,586 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000002
2015-03-13 10:07:18,586 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:18,586 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:18,586 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,586 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:18,586 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:18,587 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000002 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:18,594 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000003 is : 143
2015-03-13 10:07:18,604 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:18,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:18,605 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:18,605 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000003 from application application_1426266260362_0010
2015-03-13 10:07:18,606 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:18,606 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:19,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:19,402 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,402 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000004
2015-03-13 10:07:19,402 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,403 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,403 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000004
2015-03-13 10:07:19,403 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:19,403 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:19,403 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,404 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:19,404 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:19,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000006
2015-03-13 10:07:19,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,518 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,518 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000006
2015-03-13 10:07:19,518 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:19,519 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:19,519 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,519 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,519 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:19,519 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:19,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:19,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000003
2015-03-13 10:07:19,592 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:19,592 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:19,592 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000003
2015-03-13 10:07:19,592 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:19,592 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:19,593 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,593 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:19,593 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:19,593 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000003 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:20,405 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:20,406 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:20,406 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:20,406 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:20,406 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0010 container=Container: [ContainerId: container_1426266260362_0010_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0010_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:20,407 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:20,407 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:21,121 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:21,129 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0010_01_000007 by user soberoi
2015-03-13 10:07:21,130 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:21,130 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0010_01_000007 to application application_1426266260362_0010
2015-03-13 10:07:21,130 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:07:21,130 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0010
2015-03-13 10:07:21,130 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0010
2015-03-13 10:07:21,130 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:21,130 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0010
2015-03-13 10:07:21,131 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:21,156 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:21,156 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:21,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007/default_container_executor.sh]
2015-03-13 10:07:21,406 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:21,406 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:21,406 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:22,130 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:07:22,411 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:22,411 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,417 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,417 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,527 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 982 Total time for transactions(ms): 42 Number of transactions batched in Syncs: 0 Number of syncs: 542 SyncTimes(ms): 168 130
2015-03-13 10:07:23,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,581 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61610 dest: /127.0.0.1:60686
2015-03-13 10:07:23,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61611 dest: /127.0.0.1:60689
2015-03-13 10:07:23,662 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120 src: /127.0.0.1:61612 dest: /127.0.0.1:60696
2015-03-13 10:07:23,677 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61612, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 13976000
2015-03-13 10:07:23,677 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,679 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,679 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61611, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 15347000
2015-03-13 10:07:23,680 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,681 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61610, dest: /127.0.0.1:60686, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 17616000
2015-03-13 10:07:23,681 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,682 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,682 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741944_1120{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,687 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0010_r_000000_0_-1932642849_1
2015-03-13 10:07:23,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0 dst=null perm=null
2015-03-13 10:07:23,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0 dst=null perm=null
2015-03-13 10:07:23,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000 dst=null perm=null
2015-03-13 10:07:23,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/_temporary/attempt_1426266260362_0010_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:23,718 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000007
2015-03-13 10:07:23,718 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:23,719 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:07:23,719 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000007
2015-03-13 10:07:23,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:23,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:23,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,729 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,733 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0010_01_000007 is : 143
2015-03-13 10:07:23,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1 dst=null perm=null
2015-03-13 10:07:23,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:23,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:23,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000 dst=null perm=null
2015-03-13 10:07:23,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2015-03-13 10:07:23,745 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:23,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary/1/task_1426266260362_0010_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:23,746 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,748 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,748 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000007
2015-03-13 10:07:23,746 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000007 from application application_1426266260362_0010
2015-03-13 10:07:23,749 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:23,749 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:23,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary dst=null perm=null
2015-03-13 10:07:23,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,759 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,762 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,775 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61598, dest: /127.0.0.1:60686, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5532991000
2015-03-13 10:07:23,775 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,776 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,776 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61597, dest: /127.0.0.1:60696, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5534006000
2015-03-13 10:07:23,776 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,777 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61596, dest: /127.0.0.1:60689, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 5535264000
2015-03-13 10:07:23,777 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,777 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,778 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741943_1119{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:23,780 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,784 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,786 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61613 dest: /127.0.0.1:60689
2015-03-13 10:07:23,787 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61614 dest: /127.0.0.1:60693
2015-03-13 10:07:23,788 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121 src: /127.0.0.1:61615 dest: /127.0.0.1:60696
2015-03-13 10:07:23,791 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61615, dest: /127.0.0.1:60696, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 1275000
2015-03-13 10:07:23,791 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,791 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,791 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61614, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 1820000
2015-03-13 10:07:23,792 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,792 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,792 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61613, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 2576000
2015-03-13 10:07:23,792 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,793 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741945_1121{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,794 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist dst=null perm=null
2015-03-13 10:07:23,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:23,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist dst=null perm=null
2015-03-13 10:07:23,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:23,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1.jhist dst=null perm=null
2015-03-13 10:07:23,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,814 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61616, bytes: 68205, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119, duration: 291000
2015-03-13 10:07:23,816 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:23,818 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61617 dest: /127.0.0.1:60693
2015-03-13 10:07:23,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61618 dest: /127.0.0.1:60686
2015-03-13 10:07:23,820 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122 src: /127.0.0.1:61619 dest: /127.0.0.1:60689
2015-03-13 10:07:23,824 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61619, dest: /127.0.0.1:60689, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 1700000
2015-03-13 10:07:23,824 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,824 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,824 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61618, dest: /127.0.0.1:60686, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 2423000
2015-03-13 10:07:23,825 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,825 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,825 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61617, dest: /127.0.0.1:60693, bytes: 67673, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, duration: 3269000
2015-03-13 10:07:23,826 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,826 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741946_1122{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:23,827 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml dst=null perm=null
2015-03-13 10:07:23,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:23,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml dst=null perm=null
2015-03-13 10:07:23,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:23,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010/job_1426266260362_0010_1_conf.xml dst=null perm=null
2015-03-13 10:07:23,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:23,836 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61616, bytes: 93437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741942_1118, duration: 265000
2015-03-13 10:07:23,838 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:23,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61620 dest: /127.0.0.1:60693
2015-03-13 10:07:23,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61621 dest: /127.0.0.1:60686
2015-03-13 10:07:23,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123 src: /127.0.0.1:61622 dest: /127.0.0.1:60696
2015-03-13 10:07:23,845 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61622, dest: /127.0.0.1:60696, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 1797000
2015-03-13 10:07:23,845 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:23,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,846 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61621, dest: /127.0.0.1:60686, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 2344000
2015-03-13 10:07:23,846 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,846 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61620, dest: /127.0.0.1:60693, bytes: 92709, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1675890031_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, duration: 3058000
2015-03-13 10:07:23,847 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:23,847 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741947_1123{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:23,848 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1675890031_1
2015-03-13 10:07:23,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,859 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:23,865 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:23,866 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0010
2015-03-13 10:07:23,866 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from RUNNING to REMOVING
2015-03-13 10:07:23,866 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0010
2015-03-13 10:07:23,866 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from REMOVING to FINISHING
2015-03-13 10:07:24,724 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:24,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:24,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000007
2015-03-13 10:07:24,725 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:24,725 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:07:24,726 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000007
2015-03-13 10:07:24,726 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:24,726 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:24,726 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:24,726 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:24,727 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:24,727 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000007 on node: host: 10.1.1.144:60711 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:24,875 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741938_1114 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:07:24,875 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741939_1115 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:24,875 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741940_1116 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:24,875 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741941_1117 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:24,875 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741943_1119 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:07:24,876 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741942_1118 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:24,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0010 dst=null perm=null
2015-03-13 10:07:24,914 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741929_1105 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:24,914 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741933_1109 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:07:24,914 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741932_1108 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:07:24,914 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741930_1106 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:07:24,914 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741934_1110 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:24,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/1967014116_lower_upper_D3E4C6231BFE4370A25221F3D9851177 dst=null perm=null
2015-03-13 10:07:24,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,915 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary
2015-03-13 10:07:24,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/_temporary dst=null perm=null
2015-03-13 10:07:24,923 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,923 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:24,924 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:24,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,927 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:24,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2015-03-13 10:07:24,929 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 184000
2015-03-13 10:07:24,937 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,937 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:24,937 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:24,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,940 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:24,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2015-03-13 10:07:24,942 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 135000
2015-03-13 10:07:24,943 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs
2015-03-13 10:07:24,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs dst=null perm=null
2015-03-13 10:07:24,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2015-03-13 10:07:24,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouplhs/part-00000 dst=null perm=null
2015-03-13 10:07:24,948 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120, duration: 146000
2015-03-13 10:07:24,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:24,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:24,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:24,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:24,969 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:24,970 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:07:24,971 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:07:24,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:07:25,004 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:07:25,004 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:07:25,004 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs"]
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] parallel execution is enabled: true
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting jobs: 2
2015-03-13 10:07:25,005 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] allocating threads: 2
2015-03-13 10:07:25,006 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (2/2)
2015-03-13 10:07:25,014 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,022 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:25,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:25,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:25,026 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 11
2015-03-13 10:07:25,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=null
2015-03-13 10:07:25,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:25,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:07:25,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,031 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61627 dest: /127.0.0.1:60696
2015-03-13 10:07:25,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61628 dest: /127.0.0.1:60689
2015-03-13 10:07:25,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61629 dest: /127.0.0.1:60693
2015-03-13 10:07:25,038 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61629, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 2553000
2015-03-13 10:07:25,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,039 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61628, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 2560000
2015-03-13 10:07:25,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,040 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61627, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 3396000
2015-03-13 10:07:25,040 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,041 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741948_1124{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,042 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,042 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar
2015-03-13 10:07:25,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:25,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:25,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:25,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:07:25,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:07:25,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:07:25,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:07:25,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:07:25,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:25,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:25,051 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:25,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:25,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,057 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split
2015-03-13 10:07:25,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,058 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,060 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61630 dest: /127.0.0.1:60696
2015-03-13 10:07:25,061 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61631 dest: /127.0.0.1:60689
2015-03-13 10:07:25,062 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61632 dest: /127.0.0.1:60686
2015-03-13 10:07:25,064 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125 src: /127.0.0.1:61633 dest: /127.0.0.1:60693
2015-03-13 10:07:25,067 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61633, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 1593000
2015-03-13 10:07:25,067 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,067 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,068 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61632, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 2040000
2015-03-13 10:07:25,068 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,068 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,068 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61631, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 2916000
2015-03-13 10:07:25,069 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,069 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,069 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61630, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 3763000
2015-03-13 10:07:25,069 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,072 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741949_1125{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,073 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,074 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,076 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:25,078 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61634 dest: /127.0.0.1:60696
2015-03-13 10:07:25,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61635 dest: /127.0.0.1:60686
2015-03-13 10:07:25,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126 src: /127.0.0.1:61636 dest: /127.0.0.1:60693
2015-03-13 10:07:25,082 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61636, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 1408000
2015-03-13 10:07:25,082 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,083 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61635, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 1830000
2015-03-13 10:07:25,083 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,084 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61634, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 2439000
2015-03-13 10:07:25,084 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,085 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741950_1126{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:25,086 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,086 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:25,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:25,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:25,089 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:25,090 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:25,093 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:25,094 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61637 dest: /127.0.0.1:60696
2015-03-13 10:07:25,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61638 dest: /127.0.0.1:60689
2015-03-13 10:07:25,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127 src: /127.0.0.1:61639 dest: /127.0.0.1:60686
2015-03-13 10:07:25,099 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61639, dest: /127.0.0.1:60686, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 1493000
2015-03-13 10:07:25,100 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:25,100 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,100 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61638, dest: /127.0.0.1:60689, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 2027000
2015-03-13 10:07:25,101 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,101 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,101 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61637, dest: /127.0.0.1:60696, bytes: 97842, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 2920000
2015-03-13 10:07:25,101 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:25,102 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741951_1127{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:25,103 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:25,104 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0011
2015-03-13 10:07:25,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=null
2015-03-13 10:07:25,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:25,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:25,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:25,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:25,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:25,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:25,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:25,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:25,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:25,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:25,119 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 11 submitted by user soberoi
2015-03-13 10:07:25,119 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0011
2015-03-13 10:07:25,119 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0011
2015-03-13 10:07:25,119 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0011
2015-03-13 10:07:25,119 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from NEW to NEW_SAVING
2015-03-13 10:07:25,119 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:25,120 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,120 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:25,120 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0011 from user: soberoi activated in queue: default
2015-03-13 10:07:25,120 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0011 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:25,120 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0011 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:25,120 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0011 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:25,120 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0011_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:25,121 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:25,121 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:25,123 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0011/
2015-03-13 10:07:25,123 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0011
2015-03-13 10:07:25,123 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0011/
2015-03-13 10:07:25,534 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:25,534 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:25,534 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:07:25,535 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0011_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:25,535 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:25,535 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:25,535 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:25,536 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0011 AttemptId: appattempt_1426266260362_0011_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:07:25,536 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:25,536 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,536 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:25,536 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0011_000001
2015-03-13 10:07:25,536 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,537 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0011_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:07:25,539 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:25,540 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000001 by user soberoi
2015-03-13 10:07:25,540 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0011
2015-03-13 10:07:25,540 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:25,540 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from NEW to INITING
2015-03-13 10:07:25,540 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000001 to application application_1426266260362_0011
2015-03-13 10:07:25,540 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0011_000001
2015-03-13 10:07:25,541 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from INITING to RUNNING
2015-03-13 10:07:25,541 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:25,541 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:25,541 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:25,541 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:25,541 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000001
2015-03-13 10:07:25,551 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0011_01_000001.tokens. Credentials list:
2015-03-13 10:07:25,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:25,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0011_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001.tokens
2015-03-13 10:07:25,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:25,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:25,701 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61643, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 498000
2015-03-13 10:07:25,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,727 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:25,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:25,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:25,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:25,741 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 175000
2015-03-13 10:07:25,754 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:25,777 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 138000
2015-03-13 10:07:25,789 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:25,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:25,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:25,815 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1099241494_5992, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 288000
2015-03-13 10:07:25,827 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:25,827 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:25,852 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:25,852 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:25,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001/default_container_executor.sh]
2015-03-13 10:07:26,252 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,253 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,254 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,443 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:26,443 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,443 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,444 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,453 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:26,534 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:26,534 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:26,616 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,617 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,617 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,619 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,626 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,626 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126
2015-03-13 10:07:26,626 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741944_1120
2015-03-13 10:07:26,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741943_1119
2015-03-13 10:07:26,627 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741947_1123
2015-03-13 10:07:26,628 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:26,628 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,646 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741946_1122
2015-03-13 10:07:26,647 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127
2015-03-13 10:07:26,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121
2015-03-13 10:07:26,702 INFO hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:07:26,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:07:26,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:07:26,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary dst=null perm=null
2015-03-13 10:07:26,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary dst=null perm=null
2015-03-13 10:07:26,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary dst=null perm=null
2015-03-13 10:07:26,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61625, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741853_1029, duration: 139000
2015-03-13 10:07:26,713 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0002,submitTime=1426266286369,launchTime=1426266289929,firstMapTaskLaunchTime=1426266292118,firstReduceTaskLaunchTime=0,finishTime=1426266302068,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B229A65FB52F476791CA626E2F4F95DF/B348F1FAB7B345A48FA5BE9A6836732D] upper1*upper2*lower/(2/2)
2015-03-13 10:07:26,714 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary]
2015-03-13 10:07:26,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741866_1042, duration: 163000
2015-03-13 10:07:26,713 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0003,submitTime=1426266303375,launchTime=1426266306986,firstMapTaskLaunchTime=1426266309145,firstReduceTaskLaunchTime=0,finishTime=1426266318647,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[B229A65FB52F476791CA626E2F4F95DF/98FC3601A29C48A6B4344FEFB9E0B80E] upper1*upper2*lower/(1/2) ...rm/joinaroundjoinleftmost
2015-03-13 10:07:26,714 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61645, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741838_1014, duration: 180000
2015-03-13 10:07:26,714 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary]
2015-03-13 10:07:26,715 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0001,submitTime=1426266268849,launchTime=1426266272460,firstMapTaskLaunchTime=1426266274650,firstReduceTaskLaunchTime=0,finishTime=1426266284818,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotSeconds=0,jobName=[3CE1BF9BD7C747EDB1F8A6829F563276/1F14FA6CB9B54C3AB9069C6E50F98834] lower*upper/(1/1) ...splatform/joininnersingle
2015-03-13 10:07:26,715 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary]
2015-03-13 10:07:26,716 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741853_1029 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:26,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002.summary dst=null perm=null
2015-03-13 10:07:26,717 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741866_1042 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:26,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003.summary dst=null perm=null
2015-03-13 10:07:26,718 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741838_1014 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:26,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001.summary dst=null perm=null
2015-03-13 10:07:26,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,722 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,723 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:07:26,723 INFO hs.HistoryFileManager (HistoryFileManager.java:makeDoneSubdir(885)) - Perms after creating 504, Expected: 504
2015-03-13 10:07:26,723 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,724 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,728 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:26,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003-1426266303375-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2F98FC3601A29C48A6-1426266318647-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002-1426266286369-soberoi-%5BB229A65FB52F476791CA626E2F4F95DF%2FB348F1FAB7B345A4-1426266302068-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001-1426266268849-soberoi-%5B3CE1BF9BD7C747EDB1F8A6829F563276%2F1F14FA6CB9B54C3A-1426266284818-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,730 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003_conf.xml
2015-03-13 10:07:26,731 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002_conf.xml
2015-03-13 10:07:26,731 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001_conf.xml
2015-03-13 10:07:26,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0003_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0003_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0001_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0001_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0002_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0002_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary dst=null perm=null
2015-03-13 10:07:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary dst=null perm=null
2015-03-13 10:07:26,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary dst=null perm=null
2015-03-13 10:07:26,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741879_1055, duration: 160000
2015-03-13 10:07:26,735 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0004,submitTime=1426266320047,launchTime=1426266323734,firstMapTaskLaunchTime=1426266325900,firstReduceTaskLaunchTime=0,finishTime=1426266336413,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=49,reduceSlotSeconds=0,jobName=[DF98BEF6B79549DA8449852A7CBDC6EB/5EF25D47FD21419386DBBAEE8B2D20AA] tail/(1/1) ...ipesplatform/renamedpipes
2015-03-13 10:07:26,735 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary]
2015-03-13 10:07:26,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61646, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741894_1070, duration: 181000
2015-03-13 10:07:26,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61647, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741899_1075, duration: 147000
2015-03-13 10:07:26,736 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741879_1055 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:07:26,736 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0006,submitTime=1426266337924,launchTime=1426266355981,firstMapTaskLaunchTime=1426266358186,firstReduceTaskLaunchTime=1426266371088,finishTime=1426266373769,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=53,reduceSlotSeconds=2,jobName=[FC83D3BF82BA4B999048416E4B0AF853/1744C2BC8C1542818B6974502505089D] lower*upper/(2/3)
2015-03-13 10:07:26,736 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary]
2015-03-13 10:07:26,736 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0005,submitTime=1426266337896,launchTime=1426266341433,firstMapTaskLaunchTime=1426266343596,firstReduceTaskLaunchTime=1426266356557,finishTime=1426266363636,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=55,reduceSlotSeconds=7,jobName=[FC83D3BF82BA4B999048416E4B0AF853/1C978E7C0B2B420185FC2705C6894108] lower*upper/(1/3)
2015-03-13 10:07:26,736 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary]
2015-03-13 10:07:26,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004.summary dst=null perm=null
2015-03-13 10:07:26,738 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741899_1075 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:26,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006.summary dst=null perm=null
2015-03-13 10:07:26,738 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741894_1070 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:07:26,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005.summary dst=null perm=null
2015-03-13 10:07:26,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,740 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,740 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,740 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004-1426266320047-soberoi-%5BDF98BEF6B79549DA8449852A7CBDC6EB%2F5EF25D47FD214193-1426266336413-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006-1426266337924-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1744C2BC8C154281-1426266373769-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,741 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004_conf.xml
2015-03-13 10:07:26,741 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006_conf.xml
2015-03-13 10:07:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005-1426266337896-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F1C978E7C0B2B4201-1426266363636-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,742 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005_conf.xml
2015-03-13 10:07:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0004_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0004_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0006_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0006_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0005_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0005_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary dst=null perm=null
2015-03-13 10:07:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary dst=null perm=null
2015-03-13 10:07:26,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary dst=null perm=null
2015-03-13 10:07:26,745 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61624, bytes: 443, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741909_1085, duration: 164000
2015-03-13 10:07:26,745 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0007,submitTime=1426266375072,launchTime=1426266378909,firstMapTaskLaunchTime=1426266381055,firstReduceTaskLaunchTime=0,finishTime=1426266383818,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=1,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=0,jobName=[FC83D3BF82BA4B999048416E4B0AF853/28CD4D9B5CB64D6CB627C92EC12090D1] lower*upper/(3/3) ...dpipesplatform/afterevery
2015-03-13 10:07:26,745 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary]
2015-03-13 10:07:26,745 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61644, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741921_1097, duration: 194000
2015-03-13 10:07:26,745 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0008,submitTime=1426266385192,launchTime=1426266388961,firstMapTaskLaunchTime=1426266391120,firstReduceTaskLaunchTime=1426266402057,finishTime=1426266404636,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=2,jobName=[60C5B77597CA4154960349C96889F7F7/B3FE72BB40B045389F47AAE64AC74701] cogrouping/(1/1) ...intocogrouplhsswappedjoin
2015-03-13 10:07:26,746 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary]
2015-03-13 10:07:26,746 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61648, bytes: 414, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741935_1111, duration: 131000
2015-03-13 10:07:26,746 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0009,submitTime=1426266405973,launchTime=1426266409237,firstMapTaskLaunchTime=1426266411406,firstReduceTaskLaunchTime=0,finishTime=1426266421982,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[E808F612428A4495876D015977ED92F6/A1D84621FEBB4086ADCD0292D5B55714] cogrouping/(2/2)
2015-03-13 10:07:26,746 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741909_1085 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:07:26,746 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary]
2015-03-13 10:07:26,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007.summary dst=null perm=null
2015-03-13 10:07:26,748 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741921_1097 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:07:26,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008.summary dst=null perm=null
2015-03-13 10:07:26,748 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741935_1111 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:07:26,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009.summary dst=null perm=null
2015-03-13 10:07:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,750 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,751 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007-1426266375072-soberoi-%5BFC83D3BF82BA4B999048416E4B0AF853%2F28CD4D9B5CB64D6C-1426266383818-1-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,752 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist
2015-03-13 10:07:26,752 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007_conf.xml
2015-03-13 10:07:26,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008-1426266385192-soberoi-%5B60C5B77597CA4154960349C96889F7F7%2FB3FE72BB40B04538-1426266404636-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,753 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008_conf.xml
2015-03-13 10:07:26,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009-1426266405973-soberoi-%5BE808F612428A4495876D015977ED92F6%2FA1D84621FEBB4086-1426266421982-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0007_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0007_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0008_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0008_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,754 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009_conf.xml
2015-03-13 10:07:26,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary dst=null perm=null
2015-03-13 10:07:26,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0009_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0009_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,756 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61647, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741945_1121, duration: 181000
2015-03-13 10:07:26,756 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0010,submitTime=1426266423258,launchTime=1426266427025,firstMapTaskLaunchTime=1426266429214,firstReduceTaskLaunchTime=1426266441130,finishTime=1426266443763,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=2,jobName=[E808F612428A4495876D015977ED92F6/40D364854F8D466086D1C701E449FB16] cogrouping/(1/2) ...tform/joinsintocogrouplhs
2015-03-13 10:07:26,757 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary]
2015-03-13 10:07:26,757 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741945_1121 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:07:26,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010.summary dst=null perm=null
2015-03-13 10:07:26,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:07:26,760 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist
2015-03-13 10:07:26,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010-1426266423258-soberoi-%5BE808F612428A4495876D015977ED92F6%2F40D364854F8D4660-1426266443763-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:26,761 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010_conf.xml
2015-03-13 10:07:26,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0010_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0010_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:27,020 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:27,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125
2015-03-13 10:07:27,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:27,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:27,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED dst=null perm=null
2015-03-13 10:07:27,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:07:27,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_FAIL dst=null perm=null
2015-03-13 10:07:27,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=null
2015-03-13 10:07:27,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:07:27,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:07:27,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:27,782 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741948_1124 to datanode(s) 127.0.0.1:60686
2015-03-13 10:07:27,782 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741921_1097, blk_1073741894_1070, blk_1073741929_1105, blk_1073741866_1042, blk_1073741899_1075, blk_1073741932_1108, blk_1073741933_1109, blk_1073741934_1110, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741909_1085, blk_1073741941_1117, blk_1073741942_1118, blk_1073741943_1119, blk_1073741853_1029]
2015-03-13 10:07:27,782 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741921_1097, blk_1073741938_1114, blk_1073741939_1115, blk_1073741909_1085, blk_1073741941_1117, blk_1073741879_1055, blk_1073741945_1121, blk_1073741866_1042, blk_1073741930_1106, blk_1073741932_1108, blk_1073741933_1109, blk_1073741934_1110]
2015-03-13 10:07:27,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:27,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:27,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61650, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741950_1126, duration: 133000
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:28,434 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:28,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:28,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:28,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:28,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:28,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:28,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:28,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:28,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:28,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:28,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:28,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:28,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:28,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:28,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:28,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:28,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:28,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:28,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:28,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:28,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:28,591 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 to 127.0.0.1:60686
2015-03-13 10:07:28,591 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:28,591 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:28,593 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:28,593 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61653 dest: /127.0.0.1:60686
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:28,595 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:28,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124 src: /127.0.0.1:61653 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:07:28,595 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741948_1124 size 254067
2015-03-13 10:07:28,734 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:28,737 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:28,739 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0011_000001
2015-03-13 10:07:28,739 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0011 APPATTEMPTID=appattempt_1426266260362_0011_000001
2015-03-13 10:07:28,739 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:28,740 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from ACCEPTED to RUNNING
2015-03-13 10:07:28,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:28,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:28,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:28,951 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:28,989 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61657 dest: /127.0.0.1:60689
2015-03-13 10:07:28,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61658 dest: /127.0.0.1:60693
2015-03-13 10:07:28,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128 src: /127.0.0.1:61659 dest: /127.0.0.1:60696
2015-03-13 10:07:28,999 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61659, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 6384000
2015-03-13 10:07:29,000 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:29,000 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,000 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61658, dest: /127.0.0.1:60693, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 7118000
2015-03-13 10:07:29,001 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:29,001 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,001 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61657, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 8168000
2015-03-13 10:07:29,002 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:29,002 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741952_1128{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:29,006 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:29,543 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:29,739 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:30,012 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0010_01_000001 succeeded
2015-03-13 10:07:30,012 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:30,012 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:30,020 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,021 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0010_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:30,021 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0010_01_000001 from application application_1426266260362_0010
2015-03-13 10:07:30,022 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:30,020 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010/container_1426266260362_0010_01_000001
2015-03-13 10:07:30,022 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0010
2015-03-13 10:07:30,061 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,061 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:30,061 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:30,062 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,062 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:30,062 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,063 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,063 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:30,063 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:07:30,063 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,063 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:30,064 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,064 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,064 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:30,065 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:07:30,065 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,065 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:30,065 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,065 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,066 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:30,066 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:07:30,066 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0011_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,066 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:30,066 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,547 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:30,547 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:30,548 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:30,548 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:07:30,548 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0011 container=Container: [ContainerId: container_1426266260362_0011_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0011_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,548 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:30,548 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 10 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:30,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0010_01_000001
2015-03-13 10:07:30,744 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0010_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:30,744 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0010_000001
2015-03-13 10:07:30,744 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0010_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:30,744 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0010_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:30,744 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0010 CONTAINERID=container_1426266260362_0010_01_000001
2015-03-13 10:07:30,744 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0010 State change from FINISHING to FINISHED
2015-03-13 10:07:30,744 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0010_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:30,745 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0010_000001
2015-03-13 10:07:30,745 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:30,745 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0010
2015-03-13 10:07:30,745 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0010_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,745 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:30,745 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0010,name=[E808F612428A4495876D015977ED92F6/40D364854F8D466086D1C701E449FB16] cogrouping/(1/2) ...tform/joinsintocogrouplhs,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0010/jobhistory/job/job_1426266260362_0010,appMasterHost=Edinburgh.local,startTime=1426266423258,finishTime=1426266443866,finalStatus=SUCCEEDED
2015-03-13 10:07:30,746 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:30,746 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0010_000001 released container container_1426266260362_0010_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:30,746 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0010_000001 is done. finalState=FINISHED
2015-03-13 10:07:30,746 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0010 requests cleared
2015-03-13 10:07:30,746 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0010 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:30,746 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0010 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:30,748 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0010_000001 (auth:SIMPLE)
2015-03-13 10:07:30,749 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0010_01_000001
2015-03-13 10:07:30,778 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,778 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,779 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:30,783 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741894_1070, blk_1073741929_1105, blk_1073741930_1106, blk_1073741899_1075, blk_1073741933_1109, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741909_1085, blk_1073741942_1118, blk_1073741943_1119, blk_1073741879_1055, blk_1073741945_1121, blk_1073741853_1029]
2015-03-13 10:07:30,783 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741921_1097, blk_1073741894_1070, blk_1073741929_1105, blk_1073741930_1106, blk_1073741866_1042, blk_1073741899_1075, blk_1073741932_1108, blk_1073741934_1110, blk_1073741838_1014, blk_1073741935_1111, blk_1073741938_1114, blk_1073741939_1115, blk_1073741940_1116, blk_1073741941_1117, blk_1073741942_1118, blk_1073741879_1055, blk_1073741943_1119, blk_1073741945_1121, blk_1073741853_1029]
2015-03-13 10:07:30,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:30,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:30,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:30,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:30,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:30,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:30,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:30,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:30,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:30,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:30,908 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:30,908 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:30,911 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000004 by user soberoi
2015-03-13 10:07:30,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000005 by user soberoi
2015-03-13 10:07:30,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000002 by user soberoi
2015-03-13 10:07:30,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:30,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000006 by user soberoi
2015-03-13 10:07:30,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0011
2015-03-13 10:07:30,912 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0011_01_000003 by user soberoi
2015-03-13 10:07:30,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:30,912 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000005 to application application_1426266260362_0011
2015-03-13 10:07:30,912 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000002 to application application_1426266260362_0011
2015-03-13 10:07:30,913 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from NEW to INITING
2015-03-13 10:07:30,913 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000004 to application application_1426266260362_0011
2015-03-13 10:07:30,913 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000006 to application application_1426266260362_0011
2015-03-13 10:07:30,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:30,913 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,913 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,913 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,913 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,913 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,914 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:30,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:30,913 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0011_01_000003 to application application_1426266260362_0011
2015-03-13 10:07:30,915 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from INITING to RUNNING
2015-03-13 10:07:30,915 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,915 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,916 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,916 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:30,916 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,916 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0011
2015-03-13 10:07:30,917 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:30,917 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0011
2015-03-13 10:07:30,917 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000004
2015-03-13 10:07:30,912 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:30,921 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000003
2015-03-13 10:07:30,921 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000005
2015-03-13 10:07:30,922 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0011_01_000002
2015-03-13 10:07:30,941 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000004.tokens. Credentials list:
2015-03-13 10:07:30,942 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000005.tokens. Credentials list:
2015-03-13 10:07:30,943 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0011_01_000003.tokens. Credentials list:
2015-03-13 10:07:30,943 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0011_01_000002.tokens. Credentials list:
2015-03-13 10:07:30,957 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:30,957 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:30,960 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:31,027 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006/default_container_executor.sh]
2015-03-13 10:07:31,036 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004.tokens
2015-03-13 10:07:31,036 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:31,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,062 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,063 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:31,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:31,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar dst=null perm=null
2015-03-13 10:07:31,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61665, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_842635670_6135, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124, duration: 429000
2015-03-13 10:07:31,127 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:31,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:31,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:31,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml dst=null perm=null
2015-03-13 10:07:31,153 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61666, bytes: 98610, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_842635670_6135, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741951_1127, duration: 204000
2015-03-13 10:07:31,167 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:31,167 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,167 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:31,223 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,223 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,223 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,223 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,224 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,224 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,229 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:31,230 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:31,348 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003/default_container_executor.sh]
2015-03-13 10:07:31,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004/default_container_executor.sh]
2015-03-13 10:07:31,365 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002/default_container_executor.sh]
2015-03-13 10:07:31,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005/default_container_executor.sh]
2015-03-13 10:07:31,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921 for deletion
2015-03-13 10:07:31,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:31,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:31,435 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741921_1097 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741921
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:31,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:31,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741932_1108 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741932
2015-03-13 10:07:31,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:31,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:31,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741866_1042 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741866
2015-03-13 10:07:31,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941 for deletion
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:31,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:31,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:31,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741934_1110 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741934
2015-03-13 10:07:31,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:31,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:31,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:31,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741941_1117 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741941
2015-03-13 10:07:31,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:31,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:31,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:31,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:31,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:31,550 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,550 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:31,551 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,551 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:31,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,551 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,551 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,551 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,632 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,632 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,632 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,633 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,633 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,656 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:31,747 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:31,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0010
2015-03-13 10:07:31,747 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0010
2015-03-13 10:07:31,748 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0010 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:31,748 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0010, with delay of 10800 seconds
2015-03-13 10:07:31,784 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894 for deletion
2015-03-13 10:07:31,784 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929 for deletion
2015-03-13 10:07:31,784 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930 for deletion
2015-03-13 10:07:31,784 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741894_1070 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741894
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899 for deletion
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933 for deletion
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741929_1105 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741929
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741930_1106 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741930
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838 for deletion
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741933_1109 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741933
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935 for deletion
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741899_1075 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741899
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938 for deletion
2015-03-13 10:07:31,785 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741838_1014 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741838
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741935_1111 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741935
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853 for deletion
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741939_1115 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741939
2015-03-13 10:07:31,786 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741938_1114 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741938
2015-03-13 10:07:31,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741942_1118 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741942
2015-03-13 10:07:31,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741940_1116 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741940
2015-03-13 10:07:31,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741879_1055 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741879
2015-03-13 10:07:31,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741909_1085 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741909
2015-03-13 10:07:31,787 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741943_1119 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741943
2015-03-13 10:07:31,788 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741945_1121 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741945
2015-03-13 10:07:31,788 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741853_1029 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741853
2015-03-13 10:07:31,796 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:07:31,835 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741948_1124
2015-03-13 10:07:32,029 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128
2015-03-13 10:07:32,067 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,067 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,328 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0011_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003.tokens
2015-03-13 10:07:32,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:32,442 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,551 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,551 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:32,578 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0011_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002.tokens
2015-03-13 10:07:32,579 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:32,685 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:32,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0011_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005.tokens
2015-03-13 10:07:32,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:33,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,553 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:33,553 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:34,555 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,079 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,079 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,080 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,080 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,556 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:35,556 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,081 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,562 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:36,562 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,087 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,087 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,088 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,088 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,567 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:37,567 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,571 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:38,571 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:39,313 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61676, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 160000
2015-03-13 10:07:39,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:39,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:39,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:39,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61679, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:07:39,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:39,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job.split dst=null perm=null
2015-03-13 10:07:39,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:39,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,627 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61682, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 168000
2015-03-13 10:07:39,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61683, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 198000
2015-03-13 10:07:39,727 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61684, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 160000
2015-03-13 10:07:39,741 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61685, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741949_1125, duration: 171000
2015-03-13 10:07:39,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:39,773 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61682, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 167000
2015-03-13 10:07:39,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:39,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:39,860 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:07:39,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:07:39,884 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 150000
2015-03-13 10:07:39,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:39,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,026 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61688, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:07:40,053 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:40,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61689 dest: /127.0.0.1:60696
2015-03-13 10:07:40,122 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61690 dest: /127.0.0.1:60689
2015-03-13 10:07:40,123 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129 src: /127.0.0.1:61691 dest: /127.0.0.1:60686
2015-03-13 10:07:40,130 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61691, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 5825000
2015-03-13 10:07:40,131 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,131 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,131 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61690, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 6547000
2015-03-13 10:07:40,131 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,132 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,132 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61689, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 7651000
2015-03-13 10:07:40,132 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,133 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741953_1129{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:40,141 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0011_m_000004_0_2145797473_1
2015-03-13 10:07:40,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0 dst=null perm=null
2015-03-13 10:07:40,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0 dst=null perm=null
2015-03-13 10:07:40,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004 dst=null perm=null
2015-03-13 10:07:40,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000004_0 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,182 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,182 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000006
2015-03-13 10:07:40,182 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,182 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,195 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000006 is : 143
2015-03-13 10:07:40,196 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61692 dest: /127.0.0.1:60689
2015-03-13 10:07:40,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61693 dest: /127.0.0.1:60696
2015-03-13 10:07:40,201 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130 src: /127.0.0.1:61694 dest: /127.0.0.1:60693
2015-03-13 10:07:40,205 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist for DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,207 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,207 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,208 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000006 from application application_1426266260362_0011
2015-03-13 10:07:40,209 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,209 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,209 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,208 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000006
2015-03-13 10:07:40,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,299 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61695, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:07:40,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,330 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,344 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:07:40,349 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:07:40,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,374 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61696 dest: /127.0.0.1:60693
2015-03-13 10:07:40,376 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61698 dest: /127.0.0.1:60696
2015-03-13 10:07:40,376 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,377 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131 src: /127.0.0.1:61699 dest: /127.0.0.1:60689
2015-03-13 10:07:40,388 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61699, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 8954000
2015-03-13 10:07:40,388 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,388 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,389 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61698, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 9620000
2015-03-13 10:07:40,389 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,389 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,389 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61696, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 10327000
2015-03-13 10:07:40,390 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,390 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741955_1131{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,427 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0011_m_000001_0_834909410_1
2015-03-13 10:07:40,427 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61700 dest: /127.0.0.1:60686
2015-03-13 10:07:40,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61701 dest: /127.0.0.1:60693
2015-03-13 10:07:40,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132 src: /127.0.0.1:61702 dest: /127.0.0.1:60689
2015-03-13 10:07:40,438 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61702, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 6166000
2015-03-13 10:07:40,438 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,438 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,439 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61701, dest: /127.0.0.1:60693, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 6761000
2015-03-13 10:07:40,439 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,439 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,439 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61700, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 7565000
2015-03-13 10:07:40,440 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,440 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741956_1132{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,445 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0011_m_000000_0_-712547705_1
2015-03-13 10:07:40,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0 dst=null perm=null
2015-03-13 10:07:40,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0 dst=null perm=null
2015-03-13 10:07:40,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001 dst=null perm=null
2015-03-13 10:07:40,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000001_0 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,470 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,470 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000003
2015-03-13 10:07:40,470 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,470 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,483 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000003 is : 143
2015-03-13 10:07:40,494 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,494 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,494 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000003
2015-03-13 10:07:40,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,495 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,496 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,496 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000003 from application application_1426266260362_0011
2015-03-13 10:07:40,497 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:07:40,511 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61703, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 166000
2015-03-13 10:07:40,512 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61704, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:07:40,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0 dst=null perm=null
2015-03-13 10:07:40,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0 dst=null perm=null
2015-03-13 10:07:40,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000 dst=null perm=null
2015-03-13 10:07:40,538 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000000_0 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,542 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:40,549 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000002
2015-03-13 10:07:40,549 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,550 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,550 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:40,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000003
2015-03-13 10:07:40,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,552 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000002
2015-03-13 10:07:40,553 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:40,553 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:40,553 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000003
2015-03-13 10:07:40,553 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:40,553 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:40,553 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,553 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,553 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:40,553 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000003 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:40,571 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000002 is : 143
2015-03-13 10:07:40,584 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,585 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000002
2015-03-13 10:07:40,588 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,588 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,588 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000002 from application application_1426266260362_0011
2015-03-13 10:07:40,588 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,588 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,604 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61705 dest: /127.0.0.1:60696
2015-03-13 10:07:40,605 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61707 dest: /127.0.0.1:60686
2015-03-13 10:07:40,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133 src: /127.0.0.1:61708 dest: /127.0.0.1:60693
2015-03-13 10:07:40,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61706 dest: /127.0.0.1:60689
2015-03-13 10:07:40,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61709 dest: /127.0.0.1:60693
2015-03-13 10:07:40,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134 src: /127.0.0.1:61710 dest: /127.0.0.1:60696
2015-03-13 10:07:40,619 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61708, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 10677000
2015-03-13 10:07:40,619 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,619 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,620 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61707, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 11372000
2015-03-13 10:07:40,620 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,620 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,620 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61705, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 12021000
2015-03-13 10:07:40,621 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,621 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741957_1133{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,631 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61710, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 17921000
2015-03-13 10:07:40,631 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,632 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,632 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61709, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 18554000
2015-03-13 10:07:40,632 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,633 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,633 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61706, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 19418000
2015-03-13 10:07:40,633 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741958_1134{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:40,633 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,641 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0011_m_000002_0_-2034072183_1
2015-03-13 10:07:40,648 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0011_m_000003_0_-1611345778_1
2015-03-13 10:07:40,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0 dst=null perm=null
2015-03-13 10:07:40,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0 dst=null perm=null
2015-03-13 10:07:40,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0 dst=null perm=null
2015-03-13 10:07:40,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003 dst=null perm=null
2015-03-13 10:07:40,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000003_0 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0 dst=null perm=null
2015-03-13 10:07:40,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002 dst=null perm=null
2015-03-13 10:07:40,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/_temporary/attempt_1426266260362_0011_m_000002_0 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:40,678 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:40,678 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000005
2015-03-13 10:07:40,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000002
2015-03-13 10:07:40,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:40,679 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:40,679 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:40,679 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000002
2015-03-13 10:07:40,679 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:40,680 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:40,680 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,680 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:40,680 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:40,680 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000002 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:40,691 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000005 is : 143
2015-03-13 10:07:40,695 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000004
2015-03-13 10:07:40,696 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:40,696 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:40,696 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:07:40,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,702 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1 dst=null perm=null
2015-03-13 10:07:40,705 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,705 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:40,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000005
2015-03-13 10:07:40,707 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000004
2015-03-13 10:07:40,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000 dst=null perm=null
2015-03-13 10:07:40,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 dst=null perm=null
2015-03-13 10:07:40,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000000/part-00000 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,720 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0011_01_000004 is : 143
2015-03-13 10:07:40,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001 dst=null perm=null
2015-03-13 10:07:40,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 dst=null perm=null
2015-03-13 10:07:40,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000001/part-00001 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002 dst=null perm=null
2015-03-13 10:07:40,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 dst=null perm=null
2015-03-13 10:07:40,733 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:40,733 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,733 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:40,733 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000005 from application application_1426266260362_0011
2015-03-13 10:07:40,734 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,734 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000002/part-00002 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,736 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003 dst=null perm=null
2015-03-13 10:07:40,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 dst=null perm=null
2015-03-13 10:07:40,741 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000004
2015-03-13 10:07:40,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000003/part-00003 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,741 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:40,742 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:40,742 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000004 from application application_1426266260362_0011
2015-03-13 10:07:40,742 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:40,742 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:40,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:40,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004 dst=null perm=null
2015-03-13 10:07:40,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 dst=null perm=null
2015-03-13 10:07:40,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary/1/task_1426266260362_0011_m_000004/part-00004 dst=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_temporary dst=null perm=null
2015-03-13 10:07:40,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,768 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,775 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,789 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61694, dest: /127.0.0.1:60693, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 587256000
2015-03-13 10:07:40,790 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,790 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,791 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61693, dest: /127.0.0.1:60696, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 588469000
2015-03-13 10:07:40,791 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,792 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61692, dest: /127.0.0.1:60689, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 589886000
2015-03-13 10:07:40,792 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,792 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,793 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741954_1130{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,794 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,800 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,801 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61711 dest: /127.0.0.1:60686
2015-03-13 10:07:40,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61712 dest: /127.0.0.1:60696
2015-03-13 10:07:40,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135 src: /127.0.0.1:61713 dest: /127.0.0.1:60693
2015-03-13 10:07:40,807 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61713, dest: /127.0.0.1:60693, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 1196000
2015-03-13 10:07:40,807 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,808 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61712, dest: /127.0.0.1:60696, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 1774000
2015-03-13 10:07:40,808 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,808 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,809 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61711, dest: /127.0.0.1:60686, bytes: 410, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 2426000
2015-03-13 10:07:40,809 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,810 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741959_1135{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,811 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist dst=null perm=null
2015-03-13 10:07:40,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:40,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist dst=null perm=null
2015-03-13 10:07:40,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:07:40,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1.jhist dst=null perm=null
2015-03-13 10:07:40,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,834 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61714, bytes: 53756, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130, duration: 186000
2015-03-13 10:07:40,836 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:40,838 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61715 dest: /127.0.0.1:60696
2015-03-13 10:07:40,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61716 dest: /127.0.0.1:60689
2015-03-13 10:07:40,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136 src: /127.0.0.1:61717 dest: /127.0.0.1:60693
2015-03-13 10:07:40,843 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61717, dest: /127.0.0.1:60693, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 1578000
2015-03-13 10:07:40,844 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,844 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,844 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61716, dest: /127.0.0.1:60689, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 2175000
2015-03-13 10:07:40,844 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,845 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61715, dest: /127.0.0.1:60696, bytes: 53336, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, duration: 2884000
2015-03-13 10:07:40,845 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741960_1136{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:07:40,847 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml dst=null perm=null
2015-03-13 10:07:40,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:40,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml dst=null perm=null
2015-03-13 10:07:40,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp dst=null perm=null
2015-03-13 10:07:40,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011/job_1426266260362_0011_1_conf.xml dst=null perm=null
2015-03-13 10:07:40,860 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:40,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61718, bytes: 91486, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741952_1128, duration: 324000
2015-03-13 10:07:40,865 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:40,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61719 dest: /127.0.0.1:60696
2015-03-13 10:07:40,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61720 dest: /127.0.0.1:60686
2015-03-13 10:07:40,870 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137 src: /127.0.0.1:61721 dest: /127.0.0.1:60689
2015-03-13 10:07:40,873 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61721, dest: /127.0.0.1:60689, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 1805000
2015-03-13 10:07:40,873 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:40,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,874 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61720, dest: /127.0.0.1:60686, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 2097000
2015-03-13 10:07:40,874 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,874 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,875 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61719, dest: /127.0.0.1:60696, bytes: 90774, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1644732514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, duration: 3167000
2015-03-13 10:07:40,875 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:40,875 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741961_1137{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:40,877 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1644732514_1
2015-03-13 10:07:40,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:07:40,889 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from RUNNING to FINISHING
2015-03-13 10:07:40,889 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0011
2015-03-13 10:07:40,889 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from RUNNING to REMOVING
2015-03-13 10:07:40,889 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0011
2015-03-13 10:07:40,889 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from REMOVING to FINISHING
2015-03-13 10:07:41,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:41,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000006
2015-03-13 10:07:41,189 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,190 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,190 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000006
2015-03-13 10:07:41,190 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:41,190 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:41,190 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,190 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,190 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:41,191 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:41,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:41,468 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:41,469 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:41,469 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:41,469 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:41,470 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:41,663 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:41,663 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:41,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:41,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:41,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:41,665 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:41,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000004
2015-03-13 10:07:41,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:41,699 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000005
2015-03-13 10:07:41,700 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,700 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,700 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000004
2015-03-13 10:07:41,700 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:41,700 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:41,700 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,701 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,701 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:41,701 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000004 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:41,701 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:41,701 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:41,701 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000005
2015-03-13 10:07:41,701 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:41,701 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:41,702 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,702 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:41,702 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:41,702 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000005 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:41,844 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:41,845 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132
2015-03-13 10:07:41,846 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:41,846 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:41,847 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:41,895 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741948_1124 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:07:41,895 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741949_1125 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:07:41,896 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741950_1126 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:07:41,896 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741951_1127 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:07:41,896 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741954_1130 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:07:41,897 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741952_1128 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:07:41,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0011 dst=null perm=null
2015-03-13 10:07:41,922 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/2) ...tform/joinsintocogrouprhs
2015-03-13 10:07:41,930 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:41,938 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:41,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:07:41,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:41,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:41,943 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 12
2015-03-13 10:07:41,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=null
2015-03-13 10:07:41,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:07:41,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:07:41,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:41,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,950 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:07:41,951 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61724 dest: /127.0.0.1:60696
2015-03-13 10:07:41,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61725 dest: /127.0.0.1:60693
2015-03-13 10:07:41,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61726 dest: /127.0.0.1:60686
2015-03-13 10:07:41,958 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61726, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 2931000
2015-03-13 10:07:41,958 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:41,959 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,959 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61725, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 2792000
2015-03-13 10:07:41,959 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,959 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,960 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61724, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 3993000
2015-03-13 10:07:41,960 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,961 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741962_1138{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:07:41,962 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:41,963 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar
2015-03-13 10:07:41,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:41,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:41,966 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:41,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:41,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:07:41,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:07:41,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:07:41,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:07:41,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:07:41,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:41,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:41,973 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:41,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:41,974 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:41,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:41,976 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:41,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:41,978 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:07:41,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:41,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,981 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split
2015-03-13 10:07:41,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:41,983 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:41,984 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61727 dest: /127.0.0.1:60696
2015-03-13 10:07:41,985 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61728 dest: /127.0.0.1:60686
2015-03-13 10:07:41,986 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61729 dest: /127.0.0.1:60693
2015-03-13 10:07:41,987 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139 src: /127.0.0.1:61730 dest: /127.0.0.1:60689
2015-03-13 10:07:41,989 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61730, dest: /127.0.0.1:60689, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 1430000
2015-03-13 10:07:41,990 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:41,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,990 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61729, dest: /127.0.0.1:60693, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 1730000
2015-03-13 10:07:41,990 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,991 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,991 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61728, dest: /127.0.0.1:60686, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 2624000
2015-03-13 10:07:41,991 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,991 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,991 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61727, dest: /127.0.0.1:60696, bytes: 1772, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 3042000
2015-03-13 10:07:41,992 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:41,993 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741963_1139{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:41,994 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:41,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:41,997 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:41,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61731 dest: /127.0.0.1:60686
2015-03-13 10:07:42,000 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61732 dest: /127.0.0.1:60693
2015-03-13 10:07:42,001 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140 src: /127.0.0.1:61733 dest: /127.0.0.1:60689
2015-03-13 10:07:42,004 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61733, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 1039000
2015-03-13 10:07:42,004 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:42,004 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,004 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61732, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 1575000
2015-03-13 10:07:42,004 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,005 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,005 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61731, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 2386000
2015-03-13 10:07:42,005 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,006 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741964_1140{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:42,007 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:42,007 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:07:42,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:42,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:07:42,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:07:42,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:07:42,012 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:07:42,017 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:07:42,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61734 dest: /127.0.0.1:60689
2015-03-13 10:07:42,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61735 dest: /127.0.0.1:60693
2015-03-13 10:07:42,022 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141 src: /127.0.0.1:61736 dest: /127.0.0.1:60696
2015-03-13 10:07:42,024 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61736, dest: /127.0.0.1:60696, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 1486000
2015-03-13 10:07:42,025 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:42,025 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,025 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61735, dest: /127.0.0.1:60693, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 1838000
2015-03-13 10:07:42,025 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,025 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,026 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61734, dest: /127.0.0.1:60689, bytes: 100399, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 2531000
2015-03-13 10:07:42,026 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:42,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741965_1141{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:07:42,028 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:07:42,028 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0012
2015-03-13 10:07:42,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=null
2015-03-13 10:07:42,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:42,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:42,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:42,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:42,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:42,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:42,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:42,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:42,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:42,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:42,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:42,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:42,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:42,036 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135
2015-03-13 10:07:42,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:42,037 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 12 submitted by user soberoi
2015-03-13 10:07:42,037 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0012
2015-03-13 10:07:42,037 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0012
2015-03-13 10:07:42,038 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0012
2015-03-13 10:07:42,037 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from NEW to NEW_SAVING
2015-03-13 10:07:42,038 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:42,038 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:07:42,038 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,038 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:42,038 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from NEW to SUBMITTED
2015-03-13 10:07:42,038 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0012 from user: soberoi activated in queue: default
2015-03-13 10:07:42,039 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0012 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:07:42,039 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0012 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:07:42,039 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0012 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:07:42,039 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0012_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:07:42,039 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:07:42,040 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from SUBMITTED to ACCEPTED
2015-03-13 10:07:42,041 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0012/
2015-03-13 10:07:42,041 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0012
2015-03-13 10:07:42,041 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0012/
2015-03-13 10:07:42,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:42,195 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:42,196 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:07:42,196 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:07:42,196 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0012_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:42,196 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:07:42,196 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:42,197 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:42,197 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0012 AttemptId: appattempt_1426266260362_0012_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:07:42,198 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:07:42,198 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,198 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:07:42,198 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0012_000001
2015-03-13 10:07:42,199 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,199 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0012_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:07:42,201 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:42,202 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000001 by user soberoi
2015-03-13 10:07:42,202 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:42,202 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:07:42,202 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:42,203 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000001 to application application_1426266260362_0012
2015-03-13 10:07:42,203 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:42,203 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0012_000001
2015-03-13 10:07:42,203 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:07:42,203 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:07:42,203 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:42,203 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,203 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:42,204 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000001
2015-03-13 10:07:42,213 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0012_01_000001.tokens. Credentials list:
2015-03-13 10:07:42,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:42,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741960_1136
2015-03-13 10:07:42,242 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133
2015-03-13 10:07:42,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741954_1130
2015-03-13 10:07:42,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:42,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129
2015-03-13 10:07:42,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134
2015-03-13 10:07:42,245 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131
2015-03-13 10:07:42,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0012_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001.tokens
2015-03-13 10:07:42,304 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:42,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:42,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:42,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:42,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61740, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 481000
2015-03-13 10:07:42,387 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:42,404 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:42,405 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:42,411 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61741, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 158000
2015-03-13 10:07:42,424 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:42,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:42,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:42,442 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741961_1137
2015-03-13 10:07:42,446 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61740, bytes: 1788, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 164000
2015-03-13 10:07:42,459 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:42,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:42,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:42,482 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61741, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-250781862_6501, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 267000
2015-03-13 10:07:42,494 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:42,494 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:42,519 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:42,519 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:42,587 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001/default_container_executor.sh]
2015-03-13 10:07:42,798 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741962_1138 to datanode(s) 127.0.0.1:60689
2015-03-13 10:07:42,798 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:07:42,798 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741951_1127]
2015-03-13 10:07:43,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:43,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:43,196 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:43,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:43,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:43,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:43,436 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:43,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:43,437 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:43,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:43,438 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:43,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:43,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:43,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:43,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:43,439 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:43,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:43,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:43,440 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:43,441 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:43,441 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:43,797 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 to 127.0.0.1:60689
2015-03-13 10:07:43,799 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:07:43,800 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61742 dest: /127.0.0.1:60689
2015-03-13 10:07:43,802 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138 src: /127.0.0.1:61742 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:07:43,803 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741962_1138 size 254067
2015-03-13 10:07:44,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:07:44,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED dst=null perm=null
2015-03-13 10:07:44,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:07:44,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_FAIL dst=null perm=null
2015-03-13 10:07:44,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:44,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:44,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=null
2015-03-13 10:07:44,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:07:44,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:07:44,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:44,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.splitmetainfo dst=null perm=null
2015-03-13 10:07:44,561 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61744, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140, duration: 202000
2015-03-13 10:07:45,204 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:45,204 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:45,325 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:45,326 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0012_000001
2015-03-13 10:07:45,326 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0012 APPATTEMPTID=appattempt_1426266260362_0012_000001
2015-03-13 10:07:45,326 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:07:45,326 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from ACCEPTED to RUNNING
2015-03-13 10:07:45,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:45,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:07:45,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:07:45,543 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:07:45,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61750 dest: /127.0.0.1:60693
2015-03-13 10:07:45,586 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61751 dest: /127.0.0.1:60686
2015-03-13 10:07:45,588 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142 src: /127.0.0.1:61752 dest: /127.0.0.1:60689
2015-03-13 10:07:45,595 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61752, dest: /127.0.0.1:60689, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 5476000
2015-03-13 10:07:45,595 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:07:45,596 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,596 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61751, dest: /127.0.0.1:60686, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 6035000
2015-03-13 10:07:45,596 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:45,597 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,597 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61750, dest: /127.0.0.1:60693, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 6992000
2015-03-13 10:07:45,597 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:07:45,597 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741966_1142{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:07:45,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:07:45,803 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126]
2015-03-13 10:07:45,803 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741952_1128, blk_1073741954_1130, blk_1073741948_1124, blk_1073741949_1125, blk_1073741950_1126, blk_1073741951_1127]
2015-03-13 10:07:46,207 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:46,207 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:46,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:46,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:46,609 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:46,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,669 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:46,669 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:46,670 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,670 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:07:46,670 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,671 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,671 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:46,671 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:07:46,671 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,671 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:07:46,672 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,672 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:46,672 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:07:46,673 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,673 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:07:46,673 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,673 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,673 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:46,673 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:46,674 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:07:46,674 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0012_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,674 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:07:46,674 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,674 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,675 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,675 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:46,675 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:46,716 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:46,716 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:46,717 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:46,717 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0012_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,717 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:07:46,717 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:46,803 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952 for deletion
2015-03-13 10:07:46,803 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954 for deletion
2015-03-13 10:07:46,803 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948 for deletion
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741952_1128 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741952
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949 for deletion
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950 for deletion
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741954_1130 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741954
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741949_1125 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741949
2015-03-13 10:07:46,804 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951 for deletion
2015-03-13 10:07:46,805 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741948_1124 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741948
2015-03-13 10:07:46,805 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741951_1127 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741951
2015-03-13 10:07:46,805 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741950_1126 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741950
2015-03-13 10:07:46,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142
2015-03-13 10:07:46,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:46,851 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:46,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:46,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:47,027 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0011_01_000001 succeeded
2015-03-13 10:07:47,027 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:07:47,027 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:47,037 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011/container_1426266260362_0011_01_000001
2015-03-13 10:07:47,038 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0011_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:07:47,038 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0011_01_000001 from application application_1426266260362_0011
2015-03-13 10:07:47,038 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,038 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0011
2015-03-13 10:07:47,051 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138
2015-03-13 10:07:47,080 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141
2015-03-13 10:07:47,080 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741964_1140
2015-03-13 10:07:47,081 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139
2015-03-13 10:07:47,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 11 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:07:47,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0011_01_000001
2015-03-13 10:07:47,213 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,213 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0011_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:47,213 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0011_000001
2015-03-13 10:07:47,213 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0011_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:07:47,214 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0011_000001 State change from FINISHING to FINISHED
2015-03-13 10:07:47,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0011 CONTAINERID=container_1426266260362_0011_01_000001
2015-03-13 10:07:47,214 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0011 State change from FINISHING to FINISHED
2015-03-13 10:07:47,214 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0011_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:07:47,214 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0011_000001
2015-03-13 10:07:47,214 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:07:47,214 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0011
2015-03-13 10:07:47,215 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0011_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:47,215 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0011,name=[65C1F8B7B9BE47B0A23DAB67E3AF740D/3CA34A330FF64917AFF7341793394779] cogrouping/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0011/jobhistory/job/job_1426266260362_0011,appMasterHost=Edinburgh.local,startTime=1426266445118,finishTime=1426266460889,finalStatus=SUCCEEDED
2015-03-13 10:07:47,215 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:47,215 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:07:47,215 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0011_000001 released container container_1426266260362_0011_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:47,216 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0011_000001 is done. finalState=FINISHED
2015-03-13 10:07:47,216 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0011 requests cleared
2015-03-13 10:07:47,216 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0011 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:07:47,216 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0011 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:07:47,217 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0011_000001 (auth:SIMPLE)
2015-03-13 10:07:47,218 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0011_01_000001
2015-03-13 10:07:47,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,360 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:47,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:47,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:47,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:47,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:47,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:07:47,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:07:47,486 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:47,486 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:47,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000006 by user soberoi
2015-03-13 10:07:47,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:47,490 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:47,491 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000005 by user soberoi
2015-03-13 10:07:47,491 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:47,491 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000006 to application application_1426266260362_0012
2015-03-13 10:07:47,491 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:47,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000003 by user soberoi
2015-03-13 10:07:47,491 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,491 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:47,490 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000004 by user soberoi
2015-03-13 10:07:47,492 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000003 to application application_1426266260362_0012
2015-03-13 10:07:47,492 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000004 to application application_1426266260362_0012
2015-03-13 10:07:47,491 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,492 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,492 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,492 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,493 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,493 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,493 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000006
2015-03-13 10:07:47,491 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000002 by user soberoi
2015-03-13 10:07:47,494 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:47,491 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:47,494 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:47,492 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:47,494 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000002 to application application_1426266260362_0012
2015-03-13 10:07:47,495 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:47,495 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000005 to application application_1426266260362_0012
2015-03-13 10:07:47,495 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:47,495 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,495 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,495 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,496 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,496 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,496 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,496 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,496 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,496 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,497 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:47,497 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:47,497 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:47,498 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000004
2015-03-13 10:07:47,498 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000005
2015-03-13 10:07:47,499 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000002
2015-03-13 10:07:47,499 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000003
2015-03-13 10:07:47,518 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0012_01_000006.tokens. Credentials list:
2015-03-13 10:07:47,518 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0012_01_000004.tokens. Credentials list:
2015-03-13 10:07:47,521 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000005.tokens. Credentials list:
2015-03-13 10:07:47,522 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0012_01_000002.tokens. Credentials list:
2015-03-13 10:07:47,524 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000003.tokens. Credentials list:
2015-03-13 10:07:47,537 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:47,537 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:47,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0012_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006.tokens
2015-03-13 10:07:47,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0012_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004.tokens
2015-03-13 10:07:47,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:47,614 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:47,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,673 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:47,687 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61761, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_61318170_6649, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 495000
2015-03-13 10:07:47,687 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61760, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1718762658_6648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 556000
2015-03-13 10:07:47,707 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,707 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:47,717 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:47,717 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:07:47,717 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,717 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0011
2015-03-13 10:07:47,717 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:47,717 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0011, with delay of 10800 seconds
2015-03-13 10:07:47,717 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,717 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,718 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:47,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:47,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61760, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1718762658_6648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 263000
2015-03-13 10:07:47,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61762, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_61318170_6649, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 250000
2015-03-13 10:07:47,750 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,750 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:47,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,751 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:47,819 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,819 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,828 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,828 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,830 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,830 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,830 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,830 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,831 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:47,831 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:47,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005/default_container_executor.sh]
2015-03-13 10:07:47,975 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003/default_container_executor.sh]
2015-03-13 10:07:48,002 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006/default_container_executor.sh]
2015-03-13 10:07:48,002 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004/default_container_executor.sh]
2015-03-13 10:07:48,003 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002/default_container_executor.sh]
2015-03-13 10:07:48,217 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,217 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:07:48,217 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,217 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0011
2015-03-13 10:07:48,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,218 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0011 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:07:48,218 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0011, with delay of 10800 seconds
2015-03-13 10:07:48,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,218 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0011
2015-03-13 10:07:48,374 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:07:48,677 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,677 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,678 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,721 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:48,787 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:48,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003.tokens
2015-03-13 10:07:48,925 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,031 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:49,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0012_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002.tokens
2015-03-13 10:07:49,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,221 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,279 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:49,401 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0012_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005.tokens
2015-03-13 10:07:49,401 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:49,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:49,723 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,686 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:50,729 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,230 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,686 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:51,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,692 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:52,738 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,237 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:53,742 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,242 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,700 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,700 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:54,746 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,704 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:55,749 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:56,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:56,248 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:56,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:56,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.split dst=null perm=null
2015-03-13 10:07:56,388 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61775, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 219000
2015-03-13 10:07:56,441 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61777, bytes: 1272, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000002_0_516492625_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 160000
2015-03-13 10:07:56,454 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 1788, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 158000
2015-03-13 10:07:56,461 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61779, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000003_0_-1098418618_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 151000
2015-03-13 10:07:56,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:56,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61781, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 163000
2015-03-13 10:07:56,546 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61780, bytes: 756, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000004_0_-1581186145_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741963_1139, duration: 156000
2015-03-13 10:07:56,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:56,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:07:56,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:56,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61782, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000003_0_-1098418618_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 146000
2015-03-13 10:07:56,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:07:56,653 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61783, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000004_0_-1581186145_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 188000
2015-03-13 10:07:56,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,709 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:56,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61784, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000002_0_516492625_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 156000
2015-03-13 10:07:57,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000002_0 dst=null perm=null
2015-03-13 10:07:57,097 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000004
2015-03-13 10:07:57,097 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,097 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000004
2015-03-13 10:07:57,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,098 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,110 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000004 is : 143
2015-03-13 10:07:57,112 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:07:57,114 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61785 dest: /127.0.0.1:60686
2015-03-13 10:07:57,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61786 dest: /127.0.0.1:60696
2015-03-13 10:07:57,117 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143 src: /127.0.0.1:61787 dest: /127.0.0.1:60693
2015-03-13 10:07:57,121 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist for DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:07:57,125 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000004
2015-03-13 10:07:57,127 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,127 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,127 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000004 from application application_1426266260362_0012
2015-03-13 10:07:57,127 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,128 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 dst=null perm=null
2015-03-13 10:07:57,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 dst=null perm=null
2015-03-13 10:07:57,140 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61788, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 164000
2015-03-13 10:07:57,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000003_0 dst=null perm=null
2015-03-13 10:07:57,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 dst=null perm=null
2015-03-13 10:07:57,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 dst=null perm=null
2015-03-13 10:07:57,160 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61789, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 149000
2015-03-13 10:07:57,163 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 dst=null perm=null
2015-03-13 10:07:57,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 dst=null perm=null
2015-03-13 10:07:57,166 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 161000
2015-03-13 10:07:57,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,167 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,167 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000005
2015-03-13 10:07:57,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000004
2015-03-13 10:07:57,168 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,168 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,168 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,168 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000004
2015-03-13 10:07:57,168 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:07:57,168 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:07:57,169 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,169 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,169 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:07:57,169 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000004 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:07:57,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 dst=null perm=null
2015-03-13 10:07:57,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 dst=null perm=null
2015-03-13 10:07:57,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 147000
2015-03-13 10:07:57,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 dst=null perm=null
2015-03-13 10:07:57,179 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000005 is : 143
2015-03-13 10:07:57,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 dst=null perm=null
2015-03-13 10:07:57,183 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61790, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000001_0_-1765952810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 144000
2015-03-13 10:07:57,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:07:57,192 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,192 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,193 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,193 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000005 from application application_1426266260362_0012
2015-03-13 10:07:57,193 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,193 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000001_0 dst=null perm=null
2015-03-13 10:07:57,226 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 dst=null perm=null
2015-03-13 10:07:57,226 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,226 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000003
2015-03-13 10:07:57,226 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,227 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000005
2015-03-13 10:07:57,227 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,228 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,228 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000005
2015-03-13 10:07:57,228 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:07:57,228 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:07:57,228 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,228 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,228 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:07:57,228 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:07:57,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00000 dst=null perm=null
2015-03-13 10:07:57,236 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61791, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741956_1132, duration: 155000
2015-03-13 10:07:57,239 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000003 is : 143
2015-03-13 10:07:57,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 dst=null perm=null
2015-03-13 10:07:57,249 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00001 dst=null perm=null
2015-03-13 10:07:57,252 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741955_1131, duration: 157000
2015-03-13 10:07:57,253 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,254 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,256 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000003
2015-03-13 10:07:57,257 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,257 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,257 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000003 from application application_1426266260362_0012
2015-03-13 10:07:57,257 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,257 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 dst=null perm=null
2015-03-13 10:07:57,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00002 dst=null perm=null
2015-03-13 10:07:57,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000004_0 dst=null perm=null
2015-03-13 10:07:57,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61792, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741957_1133, duration: 159000
2015-03-13 10:07:57,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 dst=null perm=null
2015-03-13 10:07:57,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00003 dst=null perm=null
2015-03-13 10:07:57,268 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741958_1134, duration: 164000
2015-03-13 10:07:57,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 dst=null perm=null
2015-03-13 10:07:57,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4/part-00004 dst=null perm=null
2015-03-13 10:07:57,274 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61778, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741953_1129, duration: 156000
2015-03-13 10:07:57,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61793, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0012_m_000000_0_1886885524_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 191000
2015-03-13 10:07:57,281 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000006
2015-03-13 10:07:57,281 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:57,281 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,281 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000006
2015-03-13 10:07:57,282 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:07:57,295 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000006 is : 143
2015-03-13 10:07:57,307 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000006
2015-03-13 10:07:57,308 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:57,309 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,309 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000006 from application application_1426266260362_0012
2015-03-13 10:07:57,309 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,309 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:57,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_m_000000_0 dst=null perm=null
2015-03-13 10:07:57,324 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000002
2015-03-13 10:07:57,325 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:57,325 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:07:57,325 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:57,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:57,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000003
2015-03-13 10:07:57,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:57,326 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:07:57,326 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000003
2015-03-13 10:07:57,326 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:07:57,327 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:07:57,327 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,327 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:57,327 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:07:57,327 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:07:57,327 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000002
2015-03-13 10:07:57,339 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000002 is : 143
2015-03-13 10:07:57,351 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:07:57,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:57,353 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:07:57,354 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000002 from application application_1426266260362_0012
2015-03-13 10:07:57,354 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:57,354 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:07:58,249 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:58,286 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:58,286 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000006
2015-03-13 10:07:58,287 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:58,287 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:07:58,287 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000006
2015-03-13 10:07:58,287 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:58,287 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:07:58,288 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,288 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,288 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:58,288 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:58,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:07:58,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000002
2015-03-13 10:07:58,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:07:58,328 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:07:58,328 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000002
2015-03-13 10:07:58,328 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:07:58,328 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:07:58,328 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,329 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,329 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:07:58,329 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000002 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:07:58,832 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:07:58,832 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:07:58,832 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:07:58,832 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0012 container=Container: [ContainerId: container_1426266260362_0012_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0012_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:58,833 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:07:58,833 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:07:59,251 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:59,423 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:07:59,433 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:07:59,435 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0012_01_000007 by user soberoi
2015-03-13 10:07:59,435 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0012
2015-03-13 10:07:59,435 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:07:59,436 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from NEW to INITING
2015-03-13 10:07:59,436 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0012_01_000007 to application application_1426266260362_0012
2015-03-13 10:07:59,436 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from INITING to RUNNING
2015-03-13 10:07:59,436 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:07:59,436 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0012
2015-03-13 10:07:59,436 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0012
2015-03-13 10:07:59,436 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:07:59,436 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0012
2015-03-13 10:07:59,437 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:07:59,437 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:07:59,437 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0012_01_000007
2015-03-13 10:07:59,446 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0012_01_000007.tokens. Credentials list:
2015-03-13 10:07:59,461 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:07:59,525 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0012_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007.tokens
2015-03-13 10:07:59,526 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:07:59,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:59,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:59,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar dst=null perm=null
2015-03-13 10:07:59,590 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61797, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_275684363_6969, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741962_1138, duration: 502000
2015-03-13 10:07:59,609 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:59,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:59,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:59,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml dst=null perm=null
2015-03-13 10:07:59,632 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61798, bytes: 101187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_275684363_6969, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741965_1141, duration: 293000
2015-03-13 10:07:59,644 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:07:59,645 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:07:59,670 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:07:59,670 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:07:59,735 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007/default_container_executor.sh]
2015-03-13 10:07:59,831 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:07:59,832 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:00,253 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:00,431 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:00,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:01,254 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:01,834 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:02,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,215 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:02,259 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:02,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61804 dest: /127.0.0.1:60689
2015-03-13 10:08:02,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61805 dest: /127.0.0.1:60693
2015-03-13 10:08:02,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144 src: /127.0.0.1:61806 dest: /127.0.0.1:60696
2015-03-13 10:08:02,291 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61806, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 12192000
2015-03-13 10:08:02,291 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,292 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61805, dest: /127.0.0.1:60693, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 12772000
2015-03-13 10:08:02,292 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,293 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61804, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 13635000
2015-03-13 10:08:02,293 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741968_1144{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:02,297 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0012_r_000000_0_867343697_1
2015-03-13 10:08:02,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0 dst=null perm=null
2015-03-13 10:08:02,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0 dst=null perm=null
2015-03-13 10:08:02,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000 dst=null perm=null
2015-03-13 10:08:02,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/_temporary/attempt_1426266260362_0012_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:02,329 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:08:02,330 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000007
2015-03-13 10:08:02,330 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:02,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,337 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,342 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0012_01_000007 is : 143
2015-03-13 10:08:02,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1 dst=null perm=null
2015-03-13 10:08:02,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:02,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:02,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000 dst=null perm=null
2015-03-13 10:08:02,354 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:02,354 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:02,354 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:02,355 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000007 from application application_1426266260362_0012
2015-03-13 10:08:02,355 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:02,355 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:08:02,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000007
2015-03-13 10:08:02,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2015-03-13 10:08:02,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary/1/task_1426266260362_0012_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary dst=null perm=null
2015-03-13 10:08:02,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,374 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,377 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,391 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61787, dest: /127.0.0.1:60693, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5272618000
2015-03-13 10:08:02,391 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,392 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,392 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61786, dest: /127.0.0.1:60696, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5273782000
2015-03-13 10:08:02,392 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,393 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,393 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61785, dest: /127.0.0.1:60686, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 5275236000
2015-03-13 10:08:02,394 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,394 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741967_1143{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,395 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,399 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:02,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61807 dest: /127.0.0.1:60696
2015-03-13 10:08:02,403 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61808 dest: /127.0.0.1:60693
2015-03-13 10:08:02,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145 src: /127.0.0.1:61809 dest: /127.0.0.1:60689
2015-03-13 10:08:02,407 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61809, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 1252000
2015-03-13 10:08:02,407 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,407 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,408 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61808, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 1924000
2015-03-13 10:08:02,408 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,408 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61807, dest: /127.0.0.1:60696, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 2868000
2015-03-13 10:08:02,409 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,409 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,410 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741969_1145{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:02,412 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist dst=null perm=null
2015-03-13 10:08:02,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:02,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist dst=null perm=null
2015-03-13 10:08:02,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:02,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1.jhist dst=null perm=null
2015-03-13 10:08:02,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,431 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61810, bytes: 68206, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143, duration: 287000
2015-03-13 10:08:02,434 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:02,436 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61811 dest: /127.0.0.1:60689
2015-03-13 10:08:02,437 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61812 dest: /127.0.0.1:60686
2015-03-13 10:08:02,438 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146 src: /127.0.0.1:61813 dest: /127.0.0.1:60693
2015-03-13 10:08:02,441 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61813, dest: /127.0.0.1:60693, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 1613000
2015-03-13 10:08:02,442 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,442 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,442 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61812, dest: /127.0.0.1:60686, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 2245000
2015-03-13 10:08:02,442 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,443 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,443 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61811, dest: /127.0.0.1:60689, bytes: 67674, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, duration: 3345000
2015-03-13 10:08:02,443 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,444 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741970_1146{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:02,445 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,447 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml dst=null perm=null
2015-03-13 10:08:02,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:02,451 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:02,452 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:02,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml dst=null perm=null
2015-03-13 10:08:02,452 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:02,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:02,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012/job_1426266260362_0012_1_conf.xml dst=null perm=null
2015-03-13 10:08:02,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:02,459 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61814, bytes: 93441, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741966_1142, duration: 356000
2015-03-13 10:08:02,462 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:02,464 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61815 dest: /127.0.0.1:60696
2015-03-13 10:08:02,466 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61816 dest: /127.0.0.1:60693
2015-03-13 10:08:02,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147 src: /127.0.0.1:61817 dest: /127.0.0.1:60686
2015-03-13 10:08:02,471 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61817, dest: /127.0.0.1:60686, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 2552000
2015-03-13 10:08:02,472 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:02,472 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61816, dest: /127.0.0.1:60693, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 3287000
2015-03-13 10:08:02,473 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,473 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,474 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61815, dest: /127.0.0.1:60696, bytes: 92713, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1275124369_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, duration: 4837000
2015-03-13 10:08:02,474 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:02,474 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,475 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741971_1147{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:02,476 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1275124369_1
2015-03-13 10:08:02,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:02,489 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:02,489 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0012
2015-03-13 10:08:02,489 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from RUNNING to REMOVING
2015-03-13 10:08:02,490 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0012
2015-03-13 10:08:02,490 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from REMOVING to FINISHING
2015-03-13 10:08:03,262 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:03,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:03,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000007
2015-03-13 10:08:03,337 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:03,337 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:08:03,337 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000007
2015-03-13 10:08:03,337 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:03,337 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:03,337 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:03,337 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:03,338 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:03,338 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:03,497 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741962_1138 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:08:03,497 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741963_1139 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:08:03,497 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741964_1140 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:08:03,497 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741965_1141 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:08:03,497 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741967_1143 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:03,498 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741966_1142 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:08:03,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0012 dst=null perm=null
2015-03-13 10:08:03,529 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741956_1132 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:08:03,529 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741955_1131 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:08:03,529 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741957_1133 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:08:03,529 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741958_1134 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:08:03,529 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741953_1129 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:08:03,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/4035575745_lower_upper_3F05ACD6A66E43F5AAED32D0B89C58B4 dst=null perm=null
2015-03-13 10:08:03,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,531 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary
2015-03-13 10:08:03,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/_temporary dst=null perm=null
2015-03-13 10:08:03,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,538 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,539 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,541 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2015-03-13 10:08:03,544 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61819, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 164000
2015-03-13 10:08:03,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,552 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,553 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,556 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2015-03-13 10:08:03,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61819, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 162000
2015-03-13 10:08:03,559 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs
2015-03-13 10:08:03,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs dst=null perm=null
2015-03-13 10:08:03,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2015-03-13 10:08:03,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogrouprhs/part-00000 dst=null perm=null
2015-03-13 10:08:03,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144, duration: 123000
2015-03-13 10:08:03,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:03,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:03,664 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,665 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:03,665 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:03,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher"]
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:08:03,687 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:08:03,688 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dpipesplatform/joinhasher
2015-03-13 10:08:03,697 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,706 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:03,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:03,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:03,711 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 13
2015-03-13 10:08:03,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=null
2015-03-13 10:08:03,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:03,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:08:03,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:03,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,718 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:03,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61822 dest: /127.0.0.1:60686
2015-03-13 10:08:03,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61823 dest: /127.0.0.1:60693
2015-03-13 10:08:03,721 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61824 dest: /127.0.0.1:60696
2015-03-13 10:08:03,725 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61824, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 2596000
2015-03-13 10:08:03,725 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,726 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61823, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 2628000
2015-03-13 10:08:03,726 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,726 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,727 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61822, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 3468000
2015-03-13 10:08:03,727 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,728 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741972_1148{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,729 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,729 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar
2015-03-13 10:08:03,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:03,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:03,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:03,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:03,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:08:03,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:08:03,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:08:03,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:08:03,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:08:03,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:03,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:03,737 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:03,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:03,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,741 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split
2015-03-13 10:08:03,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:03,742 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:03,744 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61825 dest: /127.0.0.1:60693
2015-03-13 10:08:03,745 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61826 dest: /127.0.0.1:60689
2015-03-13 10:08:03,746 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61827 dest: /127.0.0.1:60686
2015-03-13 10:08:03,747 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149 src: /127.0.0.1:61828 dest: /127.0.0.1:60696
2015-03-13 10:08:03,750 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61828, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 1861000
2015-03-13 10:08:03,751 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,751 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,751 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61827, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 2333000
2015-03-13 10:08:03,751 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,752 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61826, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 3223000
2015-03-13 10:08:03,752 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,752 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,753 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741973_1149{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:03,753 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61825, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 4168000
2015-03-13 10:08:03,753 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,755 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741973_1149 size 1782
2015-03-13 10:08:03,755 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,758 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,760 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:03,761 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61829 dest: /127.0.0.1:60693
2015-03-13 10:08:03,762 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61830 dest: /127.0.0.1:60696
2015-03-13 10:08:03,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150 src: /127.0.0.1:61831 dest: /127.0.0.1:60686
2015-03-13 10:08:03,766 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61831, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 1059000
2015-03-13 10:08:03,766 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,767 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,767 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61830, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 1553000
2015-03-13 10:08:03,767 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,768 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,768 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61829, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 2307000
2015-03-13 10:08:03,768 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,770 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741974_1150{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,772 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,772 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:08:03,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:03,776 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:03,776 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:03,776 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:03,779 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:03,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61832 dest: /127.0.0.1:60693
2015-03-13 10:08:03,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61833 dest: /127.0.0.1:60696
2015-03-13 10:08:03,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151 src: /127.0.0.1:61834 dest: /127.0.0.1:60686
2015-03-13 10:08:03,785 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61834, dest: /127.0.0.1:60686, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 1561000
2015-03-13 10:08:03,786 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:03,786 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,786 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61833, dest: /127.0.0.1:60696, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 1903000
2015-03-13 10:08:03,786 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,786 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61832, dest: /127.0.0.1:60693, bytes: 98112, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 2765000
2015-03-13 10:08:03,787 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:03,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741975_1151{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:03,789 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:03,789 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0013
2015-03-13 10:08:03,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=null
2015-03-13 10:08:03,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:03,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:03,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:03,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:03,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:03,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:03,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:03,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:03,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:03,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:03,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:03,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:03,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:03,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:03,799 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 13 submitted by user soberoi
2015-03-13 10:08:03,799 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0013
2015-03-13 10:08:03,800 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0013
2015-03-13 10:08:03,800 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0013
2015-03-13 10:08:03,800 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from NEW to NEW_SAVING
2015-03-13 10:08:03,800 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:03,800 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0013_000001
2015-03-13 10:08:03,800 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:03,801 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0013 from user: soberoi activated in queue: default
2015-03-13 10:08:03,801 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0013 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:03,801 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0013 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:03,801 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0013 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:03,801 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0013_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:03,801 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:03,802 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:03,803 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0013/
2015-03-13 10:08:03,804 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0013
2015-03-13 10:08:03,804 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0013/
2015-03-13 10:08:03,812 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073741972_1148 to datanode(s) 127.0.0.1:60689
2015-03-13 10:08:03,813 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741953_1129, blk_1073741955_1131, blk_1073741957_1133, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741965_1141, blk_1073741967_1143]
2015-03-13 10:08:03,813 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741953_1129, blk_1073741955_1131, blk_1073741956_1132, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741965_1141, blk_1073741966_1142]
2015-03-13 10:08:04,263 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:04,264 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:04,264 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:04,264 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:08:04,264 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:04,264 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:04,264 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:04,265 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:04,266 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0013 AttemptId: appattempt_1426266260362_0013_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:04,266 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:04,266 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,266 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:04,266 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0013_000001
2015-03-13 10:08:04,267 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,267 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0013_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:08:04,269 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:04,270 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000001 by user soberoi
2015-03-13 10:08:04,270 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0013
2015-03-13 10:08:04,270 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:04,271 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from NEW to INITING
2015-03-13 10:08:04,271 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000001 to application application_1426266260362_0013
2015-03-13 10:08:04,271 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0013_000001
2015-03-13 10:08:04,271 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from INITING to RUNNING
2015-03-13 10:08:04,271 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:04,271 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:04,271 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:04,272 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:04,272 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000001
2015-03-13 10:08:04,281 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0013_01_000001.tokens. Credentials list:
2015-03-13 10:08:04,296 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:04,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0013_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001.tokens
2015-03-13 10:08:04,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:04,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:04,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:04,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:04,436 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 474000
2015-03-13 10:08:04,452 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:04,452 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:04,452 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:04,453 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:04,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:04,457 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:04,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:04,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:04,480 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61838, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 164000
2015-03-13 10:08:04,492 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:04,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:04,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:04,515 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 169000
2015-03-13 10:08:04,526 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:04,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:04,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:04,549 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61820, bytes: 98880, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1529710652_7117, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 270000
2015-03-13 10:08:04,562 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:04,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:04,585 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:04,585 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:04,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001/default_container_executor.sh]
2015-03-13 10:08:04,814 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 to 127.0.0.1:60689
2015-03-13 10:08:04,815 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:04,815 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:04,815 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:04,816 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:04,815 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:04,817 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:08:04,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:04,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:04,817 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61839 dest: /127.0.0.1:60689
2015-03-13 10:08:04,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:04,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:04,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:04,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:04,819 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148 src: /127.0.0.1:61839 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:08:04,820 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741972_1148 size 254067
2015-03-13 10:08:05,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:05,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:05,269 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:06,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:06,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED dst=null perm=null
2015-03-13 10:08:06,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:08:06,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_FAIL dst=null perm=null
2015-03-13 10:08:06,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=null
2015-03-13 10:08:06,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:08:06,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:08:06,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:06,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:06,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:06,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:06,616 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61841, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150, duration: 197000
2015-03-13 10:08:06,817 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741955_1131, blk_1073741956_1132, blk_1073741957_1133, blk_1073741958_1134, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741965_1141, blk_1073741966_1142, blk_1073741967_1143]
2015-03-13 10:08:06,817 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741953_1129, blk_1073741956_1132, blk_1073741957_1133, blk_1073741962_1138, blk_1073741963_1139, blk_1073741964_1140, blk_1073741966_1142, blk_1073741967_1143]
2015-03-13 10:08:06,889 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:06,891 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:06,891 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,062 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,063 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,064 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,065 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,065 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:07,094 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741967_1143
2015-03-13 10:08:07,094 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:07,095 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,100 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,100 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741968_1144
2015-03-13 10:08:07,101 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741970_1146
2015-03-13 10:08:07,101 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145
2015-03-13 10:08:07,277 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:07,278 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:07,383 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:07,385 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0013_000001
2015-03-13 10:08:07,385 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0013 APPATTEMPTID=appattempt_1426266260362_0013_000001
2015-03-13 10:08:07,385 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:07,386 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from ACCEPTED to RUNNING
2015-03-13 10:08:07,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:07,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953 for deletion
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741953_1129 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741953
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:07,454 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:07,455 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:07,456 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:07,456 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:07,456 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:07,458 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148
2015-03-13 10:08:07,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963 for deletion
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964 for deletion
2015-03-13 10:08:07,616 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741955_1131 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741955
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965 for deletion
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741956_1132 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741956
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741957_1133 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741957
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966 for deletion
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741958_1134 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741958
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741962_1138 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741962
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967 for deletion
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741963_1139 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741963
2015-03-13 10:08:07,617 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741964_1140 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741964
2015-03-13 10:08:07,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741966_1142 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741966
2015-03-13 10:08:07,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741965_1141 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741965
2015-03-13 10:08:07,618 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741967_1143 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741967
2015-03-13 10:08:07,620 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:07,657 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151
2015-03-13 10:08:07,658 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741974_1150
2015-03-13 10:08:07,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61847 dest: /127.0.0.1:60686
2015-03-13 10:08:07,659 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741971_1147
2015-03-13 10:08:07,659 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149
2015-03-13 10:08:07,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61848 dest: /127.0.0.1:60689
2015-03-13 10:08:07,661 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152 src: /127.0.0.1:61849 dest: /127.0.0.1:60693
2015-03-13 10:08:07,668 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61849, dest: /127.0.0.1:60693, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 5168000
2015-03-13 10:08:07,668 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:07,668 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,669 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61848, dest: /127.0.0.1:60689, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 5836000
2015-03-13 10:08:07,669 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:07,669 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,669 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61847, dest: /127.0.0.1:60686, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 6805000
2015-03-13 10:08:07,669 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:07,670 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741976_1152{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:07,680 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:08,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:08,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:08,626 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0012_01_000001 succeeded
2015-03-13 10:08:08,626 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:08,626 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,634 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0012/container_1426266260362_0012_01_000001
2015-03-13 10:08:08,635 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0012_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:08,635 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0012_01_000001 from application application_1426266260362_0012
2015-03-13 10:08:08,635 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:08,635 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 12 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:09,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0012_01_000001
2015-03-13 10:08:09,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:09,290 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0012_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:09,290 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0012_000001
2015-03-13 10:08:09,290 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0012_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:09,290 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0012_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:09,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0012 CONTAINERID=container_1426266260362_0012_01_000001
2015-03-13 10:08:09,291 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0012 State change from FINISHING to FINISHED
2015-03-13 10:08:09,291 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0012_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:09,291 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0012_000001
2015-03-13 10:08:09,291 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:09,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0012
2015-03-13 10:08:09,291 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0012_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,292 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0012,name=[65C1F8B7B9BE47B0A23DAB67E3AF740D/2BC7D8F0414F4AAC967872FE1A0F4420] cogrouping/(1/2) ...tform/joinsintocogrouprhs,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0012/jobhistory/job/job_1426266260362_0012,appMasterHost=Edinburgh.local,startTime=1426266462037,finishTime=1426266482490,finalStatus=SUCCEEDED
2015-03-13 10:08:09,292 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,292 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:08:09,292 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0012_000001 released container container_1426266260362_0012_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:09,293 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,293 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:09,293 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:09,293 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,293 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:09,293 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,294 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,294 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:09,294 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:08:09,294 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0013_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,294 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0012_000001 (auth:SIMPLE)
2015-03-13 10:08:09,294 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:08:09,295 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,295 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0012_000001 is done. finalState=FINISHED
2015-03-13 10:08:09,295 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0012 requests cleared
2015-03-13 10:08:09,295 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0012 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:09,295 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0012 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:09,295 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0012_01_000001
2015-03-13 10:08:09,322 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,323 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,323 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,323 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,323 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:09,325 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:09,325 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,326 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:09,326 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,326 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:09,326 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:09,327 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,327 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:09,327 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,327 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:09,327 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:09,327 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:09,328 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0013 container=Container: [ContainerId: container_1426266260362_0013_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0013_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,328 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:08:09,328 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:09,355 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,356 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:09,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,356 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,356 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,356 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:09,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,358 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:09,356 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:09,359 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:09,423 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,423 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,424 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:09,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:09,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:09,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:09,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:09,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:09,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:09,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:09,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:09,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:09,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:09,551 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:09,551 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:09,555 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000002 by user soberoi
2015-03-13 10:08:09,555 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000005 by user soberoi
2015-03-13 10:08:09,555 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:09,555 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000002 to application application_1426266260362_0013
2015-03-13 10:08:09,555 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0013
2015-03-13 10:08:09,556 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,556 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,556 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,556 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,556 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,557 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,557 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from NEW to INITING
2015-03-13 10:08:09,557 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000005 to application application_1426266260362_0013
2015-03-13 10:08:09,557 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from INITING to RUNNING
2015-03-13 10:08:09,556 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:09,558 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000003 by user soberoi
2015-03-13 10:08:09,558 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:09,559 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000006 by user soberoi
2015-03-13 10:08:09,559 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:09,559 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000003 to application application_1426266260362_0013
2015-03-13 10:08:09,559 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,560 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,557 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,560 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,558 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0013_01_000004 by user soberoi
2015-03-13 10:08:09,560 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,561 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:09,561 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,561 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:09,561 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:09,561 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000006 to application application_1426266260362_0013
2015-03-13 10:08:09,561 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0013_01_000004 to application application_1426266260362_0013
2015-03-13 10:08:09,561 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000005
2015-03-13 10:08:09,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:09,562 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,562 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,562 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,562 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,563 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,563 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0013
2015-03-13 10:08:09,563 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:09,563 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0013
2015-03-13 10:08:09,563 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000006
2015-03-13 10:08:09,564 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0013_01_000004
2015-03-13 10:08:09,581 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000006.tokens. Credentials list:
2015-03-13 10:08:09,582 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000005.tokens. Credentials list:
2015-03-13 10:08:09,585 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0013_01_000004.tokens. Credentials list:
2015-03-13 10:08:09,602 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,603 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,609 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:09,610 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,610 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003/default_container_executor.sh]
2015-03-13 10:08:09,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002/default_container_executor.sh]
2015-03-13 10:08:09,703 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006.tokens
2015-03-13 10:08:09,704 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:09,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:09,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:09,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar dst=null perm=null
2015-03-13 10:08:09,795 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61855, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1415027228_7271, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741972_1148, duration: 472000
2015-03-13 10:08:09,821 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:09,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:09,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:09,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml dst=null perm=null
2015-03-13 10:08:09,853 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61856, bytes: 98880, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1415027228_7271, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741975_1151, duration: 264000
2015-03-13 10:08:09,873 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:09,873 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,874 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,874 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:09,916 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,916 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:09,916 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:09,916 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:10,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005/default_container_executor.sh]
2015-03-13 10:08:10,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006/default_container_executor.sh]
2015-03-13 10:08:10,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004/default_container_executor.sh]
2015-03-13 10:08:10,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,293 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:10,293 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,294 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,294 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0012
2015-03-13 10:08:10,294 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,294 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0012 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:10,294 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0012, with delay of 10800 seconds
2015-03-13 10:08:10,294 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0012
2015-03-13 10:08:10,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:10,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:10,443 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:10,903 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:11,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0013_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004.tokens
2015-03-13 10:08:11,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:11,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:11,258 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0013_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005.tokens
2015-03-13 10:08:11,258 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:11,297 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,297 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,297 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,330 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:11,330 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,105 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:12,108 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:12,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,301 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,302 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:12,472 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152
2015-03-13 10:08:13,303 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,303 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,303 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:13,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,305 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,305 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:14,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:15,343 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,316 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:16,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,322 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:17,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:17,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:17,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:17,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61867, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 121000
2015-03-13 10:08:17,878 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61868, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 153000
2015-03-13 10:08:17,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:17,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job.split dst=null perm=null
2015-03-13 10:08:17,914 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61869, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 158000
2015-03-13 10:08:18,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:18,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:18,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,023 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 175000
2015-03-13 10:08:18,024 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61872, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 152000
2015-03-13 10:08:18,029 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61873, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741973_1149, duration: 191000
2015-03-13 10:08:18,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:18,058 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61875, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 162000
2015-03-13 10:08:18,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:18,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61876, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 157000
2015-03-13 10:08:18,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:18,189 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61877, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:08:18,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:18,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:18,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:18,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:18,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:18,996 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61878, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:08:19,001 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61879, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 158000
2015-03-13 10:08:19,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,026 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 163000
2015-03-13 10:08:19,067 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61880 dest: /127.0.0.1:60693
2015-03-13 10:08:19,068 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,069 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61882 dest: /127.0.0.1:60689
2015-03-13 10:08:19,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153 src: /127.0.0.1:61883 dest: /127.0.0.1:60696
2015-03-13 10:08:19,078 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61883, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 6284000
2015-03-13 10:08:19,078 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,079 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,079 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61882, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 7132000
2015-03-13 10:08:19,079 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,080 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61880, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 8065000
2015-03-13 10:08:19,080 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,080 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741977_1153{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,090 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0013_m_000000_0_-1839122723_1
2015-03-13 10:08:19,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0 dst=null perm=null
2015-03-13 10:08:19,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0 dst=null perm=null
2015-03-13 10:08:19,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000 dst=null perm=null
2015-03-13 10:08:19,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,112 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61884 dest: /127.0.0.1:60686
2015-03-13 10:08:19,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61885 dest: /127.0.0.1:60689
2015-03-13 10:08:19,115 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154 src: /127.0.0.1:61886 dest: /127.0.0.1:60696
2015-03-13 10:08:19,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61887, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:08:19,122 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61886, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 6097000
2015-03-13 10:08:19,122 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,123 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61885, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 7027000
2015-03-13 10:08:19,123 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,124 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61884, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 8233000
2015-03-13 10:08:19,125 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,124 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,125 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741978_1154{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,129 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0013_m_000003_0_-8042734_1
2015-03-13 10:08:19,136 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,136 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000002
2015-03-13 10:08:19,136 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,136 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,136 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0 dst=null perm=null
2015-03-13 10:08:19,149 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000002 is : 143
2015-03-13 10:08:19,152 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:19,154 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61888 dest: /127.0.0.1:60686
2015-03-13 10:08:19,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61889 dest: /127.0.0.1:60696
2015-03-13 10:08:19,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155 src: /127.0.0.1:61890 dest: /127.0.0.1:60693
2015-03-13 10:08:19,161 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist for DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:19,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000002
2015-03-13 10:08:19,161 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,162 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,163 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000002 from application application_1426266260362_0013
2015-03-13 10:08:19,163 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,163 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:19,181 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:19,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61891 dest: /127.0.0.1:60689
2015-03-13 10:08:19,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61892 dest: /127.0.0.1:60686
2015-03-13 10:08:19,226 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156 src: /127.0.0.1:61893 dest: /127.0.0.1:60696
2015-03-13 10:08:19,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,239 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61893, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 11171000
2015-03-13 10:08:19,239 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,239 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,239 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61892, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 11838000
2015-03-13 10:08:19,240 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,240 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61891, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 12589000
2015-03-13 10:08:19,240 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,241 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741980_1156{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:19,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,245 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0013_m_000001_0_-775877612_1
2015-03-13 10:08:19,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:19,254 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61894, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 161000
2015-03-13 10:08:19,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0 dst=null perm=null
2015-03-13 10:08:19,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0 dst=null perm=null
2015-03-13 10:08:19,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001 dst=null perm=null
2015-03-13 10:08:19,270 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61895, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:08:19,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,271 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0013_m_000004_0_168147244_1
2015-03-13 10:08:19,282 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000003
2015-03-13 10:08:19,282 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:19,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0 dst=null perm=null
2015-03-13 10:08:19,282 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,282 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,283 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000003
2015-03-13 10:08:19,283 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:19,283 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000002
2015-03-13 10:08:19,283 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,284 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:19,284 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:19,284 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000002
2015-03-13 10:08:19,284 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:08:19,284 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:19,284 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:19,284 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:19,284 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:19,284 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:08:19,295 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000003 is : 143
2015-03-13 10:08:19,307 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,307 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:19,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:19,308 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,309 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000003 from application application_1426266260362_0013
2015-03-13 10:08:19,309 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,309 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:19,344 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61896 dest: /127.0.0.1:60689
2015-03-13 10:08:19,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61897 dest: /127.0.0.1:60693
2015-03-13 10:08:19,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157 src: /127.0.0.1:61898 dest: /127.0.0.1:60686
2015-03-13 10:08:19,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,357 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61898, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 8455000
2015-03-13 10:08:19,357 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:19,358 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,358 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61897, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 9138000
2015-03-13 10:08:19,358 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,359 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61896, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 10132000
2015-03-13 10:08:19,359 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:19,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741981_1157{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:19,365 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0013_m_000002_0_656198417_1
2015-03-13 10:08:19,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0 dst=null perm=null
2015-03-13 10:08:19,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0 dst=null perm=null
2015-03-13 10:08:19,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002 dst=null perm=null
2015-03-13 10:08:19,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:19,400 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000004
2015-03-13 10:08:19,400 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:19,400 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:08:19,401 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000004
2015-03-13 10:08:19,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:19,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:19,412 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000004 is : 143
2015-03-13 10:08:19,423 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:19,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:19,425 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:19,425 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000004 from application application_1426266260362_0013
2015-03-13 10:08:19,426 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:19,426 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0 dst=null perm=null
2015-03-13 10:08:20,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003 dst=null perm=null
2015-03-13 10:08:20,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:20,164 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:08:20,164 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000005
2015-03-13 10:08:20,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000004
2015-03-13 10:08:20,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:20,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:20,165 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,165 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,165 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000004
2015-03-13 10:08:20,166 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:08:20,166 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:08:20,166 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,166 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,166 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:20,166 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000004 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:20,173 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000005 is : 143
2015-03-13 10:08:20,180 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:20,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:20,180 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000005 from application application_1426266260362_0013
2015-03-13 10:08:20,180 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:20,180 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000005
2015-03-13 10:08:20,287 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:20,287 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,287 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000003
2015-03-13 10:08:20,288 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,288 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,288 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000003
2015-03-13 10:08:20,288 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:20,288 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:08:20,289 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,289 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,289 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:08:20,289 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:20,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0 dst=null perm=null
2015-03-13 10:08:20,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004 dst=null perm=null
2015-03-13 10:08:20,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/_temporary/attempt_1426266260362_0013_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:20,309 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000006
2015-03-13 10:08:20,309 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:20,309 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:08:20,310 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000006
2015-03-13 10:08:20,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:20,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000005
2015-03-13 10:08:20,310 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:20,310 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:20,311 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:08:20,311 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000005
2015-03-13 10:08:20,311 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:08:20,311 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:20,311 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,311 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:20,311 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:20,311 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000005 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:08:20,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,316 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1 dst=null perm=null
2015-03-13 10:08:20,323 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0013_01_000006 is : 143
2015-03-13 10:08:20,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000 dst=null perm=null
2015-03-13 10:08:20,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2015-03-13 10:08:20,332 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:20,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,332 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:20,333 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000006 from application application_1426266260362_0013
2015-03-13 10:08:20,333 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:20,333 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:20,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,333 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000006
2015-03-13 10:08:20,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001 dst=null perm=null
2015-03-13 10:08:20,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2015-03-13 10:08:20,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002 dst=null perm=null
2015-03-13 10:08:20,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2015-03-13 10:08:20,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003 dst=null perm=null
2015-03-13 10:08:20,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2015-03-13 10:08:20,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:20,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004 dst=null perm=null
2015-03-13 10:08:20,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2015-03-13 10:08:20,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary/1/task_1426266260362_0013_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary dst=null perm=null
2015-03-13 10:08:20,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,364 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,367 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,379 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61890, dest: /127.0.0.1:60693, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1220712000
2015-03-13 10:08:20,379 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,381 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,381 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61889, dest: /127.0.0.1:60696, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1221869000
2015-03-13 10:08:20,381 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,382 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,382 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61888, dest: /127.0.0.1:60686, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 1223555000
2015-03-13 10:08:20,382 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,384 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741979_1155{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,385 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,389 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:20,390 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61899 dest: /127.0.0.1:60689
2015-03-13 10:08:20,391 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61900 dest: /127.0.0.1:60693
2015-03-13 10:08:20,392 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158 src: /127.0.0.1:61901 dest: /127.0.0.1:60696
2015-03-13 10:08:20,395 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61901, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 1336000
2015-03-13 10:08:20,395 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,395 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,396 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61900, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 1833000
2015-03-13 10:08:20,396 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,396 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,396 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61899, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 2731000
2015-03-13 10:08:20,397 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741982_1158{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:20,398 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist dst=null perm=null
2015-03-13 10:08:20,409 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:20,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist dst=null perm=null
2015-03-13 10:08:20,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:20,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1.jhist dst=null perm=null
2015-03-13 10:08:20,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,424 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61902, bytes: 53729, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155, duration: 180000
2015-03-13 10:08:20,426 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:20,428 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61903 dest: /127.0.0.1:60696
2015-03-13 10:08:20,429 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61904 dest: /127.0.0.1:60689
2015-03-13 10:08:20,430 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159 src: /127.0.0.1:61905 dest: /127.0.0.1:60693
2015-03-13 10:08:20,433 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61905, dest: /127.0.0.1:60693, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 1554000
2015-03-13 10:08:20,433 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,433 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,433 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61904, dest: /127.0.0.1:60689, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 1990000
2015-03-13 10:08:20,434 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,434 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,434 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61903, dest: /127.0.0.1:60696, bytes: 53309, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, duration: 2702000
2015-03-13 10:08:20,434 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,435 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741983_1159{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:20,436 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml dst=null perm=null
2015-03-13 10:08:20,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:20,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml dst=null perm=null
2015-03-13 10:08:20,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:20,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013/job_1426266260362_0013_1_conf.xml dst=null perm=null
2015-03-13 10:08:20,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:20,446 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61906, bytes: 91634, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741976_1152, duration: 211000
2015-03-13 10:08:20,448 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:20,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61907 dest: /127.0.0.1:60693
2015-03-13 10:08:20,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61908 dest: /127.0.0.1:60696
2015-03-13 10:08:20,452 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160 src: /127.0.0.1:61909 dest: /127.0.0.1:60689
2015-03-13 10:08:20,455 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61909, dest: /127.0.0.1:60689, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 1741000
2015-03-13 10:08:20,455 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:20,456 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,456 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61908, dest: /127.0.0.1:60696, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 2377000
2015-03-13 10:08:20,456 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61907, dest: /127.0.0.1:60693, bytes: 90922, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1928401530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, duration: 3162000
2015-03-13 10:08:20,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:20,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741984_1160{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:20,459 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1928401530_1
2015-03-13 10:08:20,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:20,474 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:20,474 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0013
2015-03-13 10:08:20,474 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from RUNNING to REMOVING
2015-03-13 10:08:20,474 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0013
2015-03-13 10:08:20,474 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from REMOVING to FINISHING
2015-03-13 10:08:21,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:21,311 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:21,312 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000006
2015-03-13 10:08:21,312 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:21,312 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:08:21,313 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000006
2015-03-13 10:08:21,313 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:21,313 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:21,314 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:21,314 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:21,314 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:21,314 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:21,485 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741972_1148 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:08:21,485 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741973_1149 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:21,485 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741974_1150 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:08:21,486 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741975_1151 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:08:21,486 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741979_1155 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:21,486 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741976_1152 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:08:21,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0013 dst=null perm=null
2015-03-13 10:08:21,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,513 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary
2015-03-13 10:08:21,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/_temporary dst=null perm=null
2015-03-13 10:08:21,520 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,521 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,525 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:08:21,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2015-03-13 10:08:21,527 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 183000
2015-03-13 10:08:21,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2015-03-13 10:08:21,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 139000
2015-03-13 10:08:21,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2015-03-13 10:08:21,531 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 172000
2015-03-13 10:08:21,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2015-03-13 10:08:21,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 157000
2015-03-13 10:08:21,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2015-03-13 10:08:21,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,541 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,542 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,545 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:08:21,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2015-03-13 10:08:21,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 167000
2015-03-13 10:08:21,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2015-03-13 10:08:21,550 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61914, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 160000
2015-03-13 10:08:21,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2015-03-13 10:08:21,551 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 154000
2015-03-13 10:08:21,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2015-03-13 10:08:21,553 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 107000
2015-03-13 10:08:21,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2015-03-13 10:08:21,554 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinhasher
2015-03-13 10:08:21,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher dst=null perm=null
2015-03-13 10:08:21,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2015-03-13 10:08:21,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00000 dst=null perm=null
2015-03-13 10:08:21,558 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153, duration: 163000
2015-03-13 10:08:21,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2015-03-13 10:08:21,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00001 dst=null perm=null
2015-03-13 10:08:21,561 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156, duration: 157000
2015-03-13 10:08:21,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2015-03-13 10:08:21,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00002 dst=null perm=null
2015-03-13 10:08:21,563 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61913, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157, duration: 158000
2015-03-13 10:08:21,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2015-03-13 10:08:21,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00003 dst=null perm=null
2015-03-13 10:08:21,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61914, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154, duration: 159000
2015-03-13 10:08:21,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2015-03-13 10:08:21,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinhasher/part-00004 dst=null perm=null
2015-03-13 10:08:21,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:21,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:21,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=null
2015-03-13 10:08:21,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=null
2015-03-13 10:08:21,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,573 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:21,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61915 dest: /127.0.0.1:60696
2015-03-13 10:08:21,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61916 dest: /127.0.0.1:60693
2015-03-13 10:08:21,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161 src: /127.0.0.1:61917 dest: /127.0.0.1:60686
2015-03-13 10:08:21,579 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61917, dest: /127.0.0.1:60686, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 1072000
2015-03-13 10:08:21,579 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,579 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,579 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61916, dest: /127.0.0.1:60693, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 1382000
2015-03-13 10:08:21,579 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,580 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61915, dest: /127.0.0.1:60696, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 2133000
2015-03-13 10:08:21,580 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741985_1161{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:21,582 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,594 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,595 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:21,595 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:21,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:21,623 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] starting
2015-03-13 10:08:21,623 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt"]
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin"]
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] parallel execution is enabled: true
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] starting jobs: 2
2015-03-13 10:08:21,624 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper*joined] allocating threads: 2
2015-03-13 10:08:21,625 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] starting step: (2/2)
2015-03-13 10:08:21,633 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,643 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:21,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:21,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:21,647 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 14
2015-03-13 10:08:21,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=null
2015-03-13 10:08:21,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:21,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:08:21,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:21,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,656 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,658 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61919 dest: /127.0.0.1:60689
2015-03-13 10:08:21,659 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61920 dest: /127.0.0.1:60696
2015-03-13 10:08:21,660 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61921 dest: /127.0.0.1:60693
2015-03-13 10:08:21,665 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61921, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 2652000
2015-03-13 10:08:21,665 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,665 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,666 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61920, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 2666000
2015-03-13 10:08:21,666 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,666 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,666 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61919, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 4181000
2015-03-13 10:08:21,667 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,668 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741986_1162{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,669 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,670 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar
2015-03-13 10:08:21,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:21,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:21,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:21,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:21,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:08:21,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:08:21,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:08:21,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:08:21,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:08:21,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:21,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:21,679 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:21,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:21,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,683 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split
2015-03-13 10:08:21,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:21,684 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,685 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61922 dest: /127.0.0.1:60689
2015-03-13 10:08:21,686 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61923 dest: /127.0.0.1:60696
2015-03-13 10:08:21,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61924 dest: /127.0.0.1:60686
2015-03-13 10:08:21,688 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163 src: /127.0.0.1:61925 dest: /127.0.0.1:60693
2015-03-13 10:08:21,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61925, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 1658000
2015-03-13 10:08:21,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,692 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61924, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 2053000
2015-03-13 10:08:21,692 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,693 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61923, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 2787000
2015-03-13 10:08:21,693 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,693 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,693 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61922, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 3717000
2015-03-13 10:08:21,694 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,694 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741987_1163{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,696 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,700 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,702 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61926 dest: /127.0.0.1:60689
2015-03-13 10:08:21,703 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61927 dest: /127.0.0.1:60696
2015-03-13 10:08:21,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164 src: /127.0.0.1:61928 dest: /127.0.0.1:60693
2015-03-13 10:08:21,708 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61928, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 1252000
2015-03-13 10:08:21,708 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,708 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61927, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 1685000
2015-03-13 10:08:21,709 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,709 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,709 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61926, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 2506000
2015-03-13 10:08:21,709 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,711 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741988_1164{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,712 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,712 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:08:21,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:21,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:21,716 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:21,717 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:21,721 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:21,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61929 dest: /127.0.0.1:60696
2015-03-13 10:08:21,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61930 dest: /127.0.0.1:60689
2015-03-13 10:08:21,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165 src: /127.0.0.1:61931 dest: /127.0.0.1:60693
2015-03-13 10:08:21,727 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61931, dest: /127.0.0.1:60693, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 1474000
2015-03-13 10:08:21,727 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:21,728 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,728 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61930, dest: /127.0.0.1:60689, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 2004000
2015-03-13 10:08:21,728 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,728 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,729 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61929, dest: /127.0.0.1:60696, bytes: 98697, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 2797000
2015-03-13 10:08:21,729 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:21,730 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741989_1165{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:21,731 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:21,731 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0014
2015-03-13 10:08:21,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=null
2015-03-13 10:08:21,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:21,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:21,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:21,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:21,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:21,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:21,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:21,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:21,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:21,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:21,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:21,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:21,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:21,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:21,740 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 14 submitted by user soberoi
2015-03-13 10:08:21,740 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0014
2015-03-13 10:08:21,741 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0014
2015-03-13 10:08:21,741 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0014
2015-03-13 10:08:21,741 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from NEW to NEW_SAVING
2015-03-13 10:08:21,741 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:21,741 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0014_000001
2015-03-13 10:08:21,741 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:21,742 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0014 from user: soberoi activated in queue: default
2015-03-13 10:08:21,742 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0014 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:21,742 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0014 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:21,742 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0014_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:21,742 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0014 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:21,742 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:21,742 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:21,744 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0014/
2015-03-13 10:08:21,744 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] submitted hadoop job: job_1426266260362_0014
2015-03-13 10:08:21,744 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0014/
2015-03-13 10:08:21,835 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073741986_1162 to datanode(s) 127.0.0.1:60686
2015-03-13 10:08:21,835 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741976_1152, blk_1073741979_1155]
2015-03-13 10:08:21,835 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741979_1155]
2015-03-13 10:08:22,115 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,116 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,116 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:22,117 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:22,117 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,117 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,118 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:22,118 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,119 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:22,119 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,120 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:22,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:22,298 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:22,299 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:22,299 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:08:22,299 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:22,299 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:22,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:22,299 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:22,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0014 AttemptId: appattempt_1426266260362_0014_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:22,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:22,300 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,300 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:22,301 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0014_000001
2015-03-13 10:08:22,301 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,301 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0014_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:08:22,303 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:22,304 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000001 by user soberoi
2015-03-13 10:08:22,304 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0014
2015-03-13 10:08:22,304 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:22,305 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from NEW to INITING
2015-03-13 10:08:22,305 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000001 to application application_1426266260362_0014
2015-03-13 10:08:22,305 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from INITING to RUNNING
2015-03-13 10:08:22,305 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0014_000001
2015-03-13 10:08:22,305 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:22,305 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:22,305 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:22,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:22,306 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000001
2015-03-13 10:08:22,315 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0014_01_000001.tokens. Credentials list:
2015-03-13 10:08:22,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:22,318 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:22,319 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,319 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:22,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,321 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155
2015-03-13 10:08:22,323 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,342 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:22,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0014_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001.tokens
2015-03-13 10:08:22,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:22,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:22,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:22,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741981_1157
2015-03-13 10:08:22,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:22,479 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:22,479 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741979_1155
2015-03-13 10:08:22,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:22,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:22,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:22,495 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61911, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 507000
2015-03-13 10:08:22,514 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:22,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:22,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:22,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:22,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61912, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 134000
2015-03-13 10:08:22,554 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:22,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:22,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:22,580 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61935, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 169000
2015-03-13 10:08:22,595 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:22,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:22,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:22,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61936, bytes: 99469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-809864123_7591, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 319000
2015-03-13 10:08:22,631 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 to 127.0.0.1:60686
2015-03-13 10:08:22,631 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:22,631 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:22,632 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:22,632 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:22,633 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:22,632 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:22,633 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:08:22,632 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:22,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61937 dest: /127.0.0.1:60686
2015-03-13 10:08:22,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:22,633 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:22,633 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:22,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:22,634 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:22,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162 src: /127.0.0.1:61937 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:08:22,636 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741986_1162 size 254067
2015-03-13 10:08:22,642 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:22,643 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:22,672 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:22,672 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:22,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001/default_container_executor.sh]
2015-03-13 10:08:22,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:22,826 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:22,827 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:22,828 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:22,873 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:22,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741983_1159
2015-03-13 10:08:22,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741977_1153
2015-03-13 10:08:22,874 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164
2015-03-13 10:08:22,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741984_1160
2015-03-13 10:08:23,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165
2015-03-13 10:08:23,073 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158
2015-03-13 10:08:23,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741978_1154
2015-03-13 10:08:23,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741980_1156
2015-03-13 10:08:23,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163
2015-03-13 10:08:23,074 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161
2015-03-13 10:08:23,299 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:23,299 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:23,299 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:24,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:24,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED dst=null perm=null
2015-03-13 10:08:24,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:08:24,279 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_FAIL dst=null perm=null
2015-03-13 10:08:24,299 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:24,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:24,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=null
2015-03-13 10:08:24,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:08:24,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:08:24,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:24,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:24,686 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61939, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741988_1164, duration: 121000
2015-03-13 10:08:24,837 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741976_1152]
2015-03-13 10:08:24,837 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741972_1148, blk_1073741973_1149, blk_1073741974_1150, blk_1073741975_1151, blk_1073741976_1152, blk_1073741979_1155]
2015-03-13 10:08:25,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:25,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741974_1150 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741974
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972 for deletion
2015-03-13 10:08:25,463 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973 for deletion
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741972_1148 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741972
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976 for deletion
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741973_1149 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741973
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979 for deletion
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741975_1151 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741975
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741976_1152 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741976
2015-03-13 10:08:25,464 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741979_1155 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741979
2015-03-13 10:08:25,505 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:25,507 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0014_000001
2015-03-13 10:08:25,507 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0014 APPATTEMPTID=appattempt_1426266260362_0014_000001
2015-03-13 10:08:25,507 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:25,507 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from ACCEPTED to RUNNING
2015-03-13 10:08:25,529 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1389 Total time for transactions(ms): 61 Number of transactions batched in Syncs: 2 Number of syncs: 787 SyncTimes(ms): 239 191
2015-03-13 10:08:25,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:25,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:25,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:25,729 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:25,768 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61945 dest: /127.0.0.1:60686
2015-03-13 10:08:25,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61946 dest: /127.0.0.1:60696
2015-03-13 10:08:25,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166 src: /127.0.0.1:61947 dest: /127.0.0.1:60693
2015-03-13 10:08:25,779 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61947, dest: /127.0.0.1:60693, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 5918000
2015-03-13 10:08:25,779 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:25,780 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,780 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61946, dest: /127.0.0.1:60696, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 6981000
2015-03-13 10:08:25,780 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:25,780 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61945, dest: /127.0.0.1:60686, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 7814000
2015-03-13 10:08:25,780 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,781 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:25,781 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741990_1166{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:25,785 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:26,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:26,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:26,622 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0013_01_000001 succeeded
2015-03-13 10:08:26,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:26,622 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0013_01_000001
2015-03-13 10:08:26,629 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0013_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:26,630 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0013_01_000001 from application application_1426266260362_0013
2015-03-13 10:08:26,630 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:26,630 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0013
2015-03-13 10:08:26,630 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,629 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:26,630 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013/container_1426266260362_0013_01_000001
2015-03-13 10:08:27,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 13 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:27,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0013_01_000001
2015-03-13 10:08:27,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:27,314 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0013_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:27,314 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0013_000001
2015-03-13 10:08:27,314 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0013_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:27,314 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0013_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:27,314 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0013 CONTAINERID=container_1426266260362_0013_01_000001
2015-03-13 10:08:27,315 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0013_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:27,315 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0013 State change from FINISHING to FINISHED
2015-03-13 10:08:27,315 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:27,315 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0013
2015-03-13 10:08:27,315 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0013,name=[66292338870B4E96BCA2C279F2316D18/1DA395B3D9054135BCD4DF3C5499AF7E] lower*upper/(1/1) ...dpipesplatform/joinhasher,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0013/jobhistory/job/job_1426266260362_0013,appMasterHost=Edinburgh.local,startTime=1426266483799,finishTime=1426266500474,finalStatus=SUCCEEDED
2015-03-13 10:08:27,315 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0013_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,315 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0013_000001
2015-03-13 10:08:27,316 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,316 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1
2015-03-13 10:08:27,316 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0013_000001 released container container_1426266260362_0013_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:27,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,317 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:27,317 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:27,317 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,317 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:27,318 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,318 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,318 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:27,318 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:08:27,318 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,319 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=3
2015-03-13 10:08:27,319 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,319 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0013_000001 is done. finalState=FINISHED
2015-03-13 10:08:27,319 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0013 requests cleared
2015-03-13 10:08:27,319 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0013 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:27,319 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0013 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:27,319 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0013_000001 (auth:SIMPLE)
2015-03-13 10:08:27,320 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0013_01_000001
2015-03-13 10:08:27,329 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:27,329 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,329 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:27,329 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:27,330 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,330 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,330 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:27,330 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,330 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,330 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:27,330 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:27,331 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,331 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:27,330 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,329 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:27,329 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0013
2015-03-13 10:08:27,331 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,331 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:27,331 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0013, with delay of 10800 seconds
2015-03-13 10:08:27,331 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:27,332 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:27,332 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:27,332 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0014_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,332 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:08:27,332 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:27,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:27,526 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:27,538 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,539 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:27,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:27,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:27,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:27,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:27,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:27,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:27,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:27,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:27,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:27,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:27,661 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:27,661 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:27,664 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000006 by user soberoi
2015-03-13 10:08:27,665 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0014
2015-03-13 10:08:27,665 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:27,665 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from NEW to INITING
2015-03-13 10:08:27,665 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000006 to application application_1426266260362_0014
2015-03-13 10:08:27,665 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000005 by user soberoi
2015-03-13 10:08:27,665 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from INITING to RUNNING
2015-03-13 10:08:27,665 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:27,666 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,666 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000005 to application application_1426266260362_0014
2015-03-13 10:08:27,666 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000004 by user soberoi
2015-03-13 10:08:27,666 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:27,666 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000003 by user soberoi
2015-03-13 10:08:27,666 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000002 by user soberoi
2015-03-13 10:08:27,666 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:27,666 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:27,666 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,667 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,667 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,667 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,667 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:27,667 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:27,667 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,667 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000004 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000006
2015-03-13 10:08:27,667 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000003 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000002 to application application_1426266260362_0014
2015-03-13 10:08:27,668 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,668 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,668 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,668 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,668 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,669 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,669 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,669 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,669 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,669 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,670 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,668 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,670 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:27,670 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000005
2015-03-13 10:08:27,671 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,685 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:27,685 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:27,685 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:27,685 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0014_01_000004
2015-03-13 10:08:27,695 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162
2015-03-13 10:08:27,697 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000006.tokens. Credentials list:
2015-03-13 10:08:27,706 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000004.tokens. Credentials list:
2015-03-13 10:08:27,707 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0014_01_000005.tokens. Credentials list:
2015-03-13 10:08:27,722 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:27,722 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:27,722 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:27,723 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:27,723 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:27,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003/default_container_executor.sh]
2015-03-13 10:08:27,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002/default_container_executor.sh]
2015-03-13 10:08:27,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006.tokens
2015-03-13 10:08:27,814 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:27,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:27,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:27,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar dst=null perm=null
2015-03-13 10:08:27,908 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61953, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_915454621_7745, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741986_1162, duration: 467000
2015-03-13 10:08:27,932 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:27,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:27,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:27,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml dst=null perm=null
2015-03-13 10:08:27,965 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61954, bytes: 99469, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_915454621_7745, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741989_1165, duration: 265000
2015-03-13 10:08:27,980 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:27,980 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,980 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:27,980 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:28,027 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,027 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:28,027 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,027 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:28,078 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166
2015-03-13 10:08:28,176 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004/default_container_executor.sh]
2015-03-13 10:08:28,176 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006/default_container_executor.sh]
2015-03-13 10:08:28,176 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005/default_container_executor.sh]
2015-03-13 10:08:28,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,315 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:28,316 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0013
2015-03-13 10:08:28,316 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0013 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:28,316 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0013, with delay of 10800 seconds
2015-03-13 10:08:28,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,315 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,317 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0013
2015-03-13 10:08:28,331 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,331 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,331 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:28,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,332 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:28,553 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:29,008 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:29,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0014_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005.tokens
2015-03-13 10:08:29,122 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:29,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:29,319 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,319 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,319 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:29,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0014_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004.tokens
2015-03-13 10:08:29,367 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:30,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,323 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:30,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:31,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,332 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:32,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,336 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,337 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:33,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,341 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,341 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:34,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,345 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,345 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:35,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:35,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:35,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:36,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:36,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job.split dst=null perm=null
2015-03-13 10:08:36,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61969, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 154000
2015-03-13 10:08:36,109 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:61968, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 151000
2015-03-13 10:08:36,151 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61971, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 182000
2015-03-13 10:08:36,154 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61970, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 144000
2015-03-13 10:08:36,193 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61972, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741987_1163, duration: 154000
2015-03-13 10:08:36,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:36,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:36,253 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61973, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 203000
2015-03-13 10:08:36,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:36,281 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61970, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:08:36,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:36,293 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61971, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:08:36,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:08:36,313 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61974, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:08:36,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,357 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,357 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,358 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,780 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 174000
2015-03-13 10:08:36,785 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000000_0_-1089971764_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 173000
2015-03-13 10:08:36,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000000_0 dst=null perm=null
2015-03-13 10:08:36,832 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000001_0_2017851300_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 144000
2015-03-13 10:08:36,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,852 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,852 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000002
2015-03-13 10:08:36,852 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,852 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,853 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,865 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000002 is : 143
2015-03-13 10:08:36,867 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:36,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61977 dest: /127.0.0.1:60686
2015-03-13 10:08:36,870 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61978 dest: /127.0.0.1:60693
2015-03-13 10:08:36,871 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167 src: /127.0.0.1:61979 dest: /127.0.0.1:60689
2015-03-13 10:08:36,871 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000001_0 dst=null perm=null
2015-03-13 10:08:36,875 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist for DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:36,877 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,878 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000002 from application application_1426266260362_0014
2015-03-13 10:08:36,878 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,878 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,879 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,878 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000002
2015-03-13 10:08:36,884 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,884 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000003
2015-03-13 10:08:36,884 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,884 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,884 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000002
2015-03-13 10:08:36,885 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,885 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,885 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,885 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000002
2015-03-13 10:08:36,885 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available, release resources=true
2015-03-13 10:08:36,885 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:36,886 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,886 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,886 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:08:36,886 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000002 on node: host: 10.1.1.144:60715 #containers=2 available=1024 used=3072 with event: FINISHED
2015-03-13 10:08:36,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,897 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000003 is : 143
2015-03-13 10:08:36,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,904 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61980, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000004_0_-254394080_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:08:36,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,909 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,909 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,909 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:36,910 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,910 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000003 from application application_1426266260362_0014
2015-03-13 10:08:36,910 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,911 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,923 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61981, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000003_0_86517827_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 165000
2015-03-13 10:08:36,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:08:36,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000004_0 dst=null perm=null
2015-03-13 10:08:36,935 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:61982, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0014_m_000002_0_-934800613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 174000
2015-03-13 10:08:36,941 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,941 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000006
2015-03-13 10:08:36,941 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,953 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000006 is : 143
2015-03-13 10:08:36,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000003_0 dst=null perm=null
2015-03-13 10:08:36,964 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000005
2015-03-13 10:08:36,964 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,964 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:36,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:08:36,966 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,966 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,966 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000005
2015-03-13 10:08:36,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000006
2015-03-13 10:08:36,977 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000005 is : 143
2015-03-13 10:08:36,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_m_000002_0 dst=null perm=null
2015-03-13 10:08:36,986 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,986 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,986 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:36,986 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000006 from application application_1426266260362_0014
2015-03-13 10:08:36,986 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,986 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,986 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:36,987 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000005 from application application_1426266260362_0014
2015-03-13 10:08:36,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000005
2015-03-13 10:08:36,987 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:36,988 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:36,995 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000004
2015-03-13 10:08:36,995 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:36,995 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:08:36,996 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000004
2015-03-13 10:08:36,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:36,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000005
2015-03-13 10:08:36,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:36,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000006
2015-03-13 10:08:36,997 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,997 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,997 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000005
2015-03-13 10:08:36,997 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:08:36,997 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:08:36,997 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,997 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,998 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:08:36,998 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000005 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:36,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:36,998 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:08:36,998 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000006
2015-03-13 10:08:36,998 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:08:36,998 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:08:36,998 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:36,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:08:36,999 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000006 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:08:37,007 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000004 is : 143
2015-03-13 10:08:37,018 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:37,018 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:37,019 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000004 from application application_1426266260362_0014
2015-03-13 10:08:37,019 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:37,019 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:37,018 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,019 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000004
2015-03-13 10:08:37,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:37,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:37,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000003
2015-03-13 10:08:37,890 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:37,890 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:08:37,890 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000003
2015-03-13 10:08:37,890 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:37,890 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:37,891 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:37,891 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:37,891 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:37,891 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:37,998 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:37,999 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000004
2015-03-13 10:08:37,999 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:37,999 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:08:38,000 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000004
2015-03-13 10:08:38,000 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:38,000 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:38,000 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,000 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,001 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:38,001 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000004 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:38,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:38,895 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:38,895 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:38,895 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:08:38,895 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0014 container=Container: [ContainerId: container_1426266260362_0014_01_000007, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0014_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:38,896 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:08:38,896 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:39,599 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:39,608 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0014_01_000007 by user soberoi
2015-03-13 10:08:39,608 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:39,608 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0014_01_000007 to application application_1426266260362_0014
2015-03-13 10:08:39,609 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:08:39,609 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0014
2015-03-13 10:08:39,609 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0014
2015-03-13 10:08:39,609 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:39,609 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0014
2015-03-13 10:08:39,610 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:39,634 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:39,635 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:39,698 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007/default_container_executor.sh]
2015-03-13 10:08:39,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:39,899 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:39,899 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:40,606 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:40,904 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:40,904 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,908 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,908 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:41,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,016 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:42,070 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61989 dest: /127.0.0.1:60686
2015-03-13 10:08:42,071 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61990 dest: /127.0.0.1:60696
2015-03-13 10:08:42,072 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168 src: /127.0.0.1:61991 dest: /127.0.0.1:60693
2015-03-13 10:08:42,082 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61991, dest: /127.0.0.1:60693, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 8041000
2015-03-13 10:08:42,082 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,082 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,082 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61990, dest: /127.0.0.1:60696, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 8693000
2015-03-13 10:08:42,083 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,083 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61989, dest: /127.0.0.1:60686, bytes: 240, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 9444000
2015-03-13 10:08:42,083 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741992_1168{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:42,086 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0014_r_000000_0_1187936187_1
2015-03-13 10:08:42,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0 dst=null perm=null
2015-03-13 10:08:42,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0 dst=null perm=null
2015-03-13 10:08:42,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000 dst=null perm=null
2015-03-13 10:08:42,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/_temporary/attempt_1426266260362_0014_r_000000_0 dst=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:42,111 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:08:42,111 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000007
2015-03-13 10:08:42,111 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:42,111 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:42,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,117 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,121 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0014_01_000007 is : 143
2015-03-13 10:08:42,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1 dst=null perm=null
2015-03-13 10:08:42,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:42,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:42,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000 dst=null perm=null
2015-03-13 10:08:42,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000 dst=null perm=null
2015-03-13 10:08:42,130 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:42,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,130 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:42,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000007
2015-03-13 10:08:42,131 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000007 from application application_1426266260362_0014
2015-03-13 10:08:42,131 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:42,131 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:42,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary/1/task_1426266260362_0014_r_000000/part-00000 dst=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_temporary dst=null perm=null
2015-03-13 10:08:42,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,140 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,143 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,156 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61979, dest: /127.0.0.1:60689, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5283484000
2015-03-13 10:08:42,156 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,157 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,158 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61978, dest: /127.0.0.1:60693, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5284724000
2015-03-13 10:08:42,158 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,159 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61977, dest: /127.0.0.1:60686, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 5286043000
2015-03-13 10:08:42,159 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,159 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741991_1167{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,161 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,164 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:42,166 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61992 dest: /127.0.0.1:60696
2015-03-13 10:08:42,167 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61993 dest: /127.0.0.1:60689
2015-03-13 10:08:42,169 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169 src: /127.0.0.1:61994 dest: /127.0.0.1:60686
2015-03-13 10:08:42,171 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61994, dest: /127.0.0.1:60686, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 1420000
2015-03-13 10:08:42,171 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,172 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,172 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61993, dest: /127.0.0.1:60689, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 1895000
2015-03-13 10:08:42,172 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,173 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,173 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61992, dest: /127.0.0.1:60696, bytes: 433, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 2742000
2015-03-13 10:08:42,173 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,173 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741993_1169{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:42,175 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist dst=null perm=null
2015-03-13 10:08:42,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:42,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist dst=null perm=null
2015-03-13 10:08:42,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:42,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1.jhist dst=null perm=null
2015-03-13 10:08:42,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,193 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:61995, bytes: 67435, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167, duration: 301000
2015-03-13 10:08:42,195 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:42,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61996 dest: /127.0.0.1:60693
2015-03-13 10:08:42,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61997 dest: /127.0.0.1:60686
2015-03-13 10:08:42,199 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170 src: /127.0.0.1:61998 dest: /127.0.0.1:60696
2015-03-13 10:08:42,202 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61998, dest: /127.0.0.1:60696, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 1874000
2015-03-13 10:08:42,202 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,203 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,203 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61997, dest: /127.0.0.1:60686, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 2539000
2015-03-13 10:08:42,203 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,203 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,203 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:61996, dest: /127.0.0.1:60693, bytes: 66911, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, duration: 3378000
2015-03-13 10:08:42,204 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,204 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741994_1170{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:42,205 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml dst=null perm=null
2015-03-13 10:08:42,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:42,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml dst=null perm=null
2015-03-13 10:08:42,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:42,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014/job_1426266260362_0014_1_conf.xml dst=null perm=null
2015-03-13 10:08:42,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:42,217 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:61999, bytes: 92136, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741990_1166, duration: 263000
2015-03-13 10:08:42,219 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:42,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62000 dest: /127.0.0.1:60696
2015-03-13 10:08:42,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62001 dest: /127.0.0.1:60686
2015-03-13 10:08:42,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171 src: /127.0.0.1:62002 dest: /127.0.0.1:60689
2015-03-13 10:08:42,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62002, dest: /127.0.0.1:60689, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 1769000
2015-03-13 10:08:42,226 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:42,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,227 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62001, dest: /127.0.0.1:60686, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 2347000
2015-03-13 10:08:42,227 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,228 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62000, dest: /127.0.0.1:60696, bytes: 91420, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1408382736_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, duration: 3143000
2015-03-13 10:08:42,228 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:42,228 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741995_1171{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:42,229 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1408382736_1
2015-03-13 10:08:42,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:42,240 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:42,240 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0014
2015-03-13 10:08:42,241 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from RUNNING to REMOVING
2015-03-13 10:08:42,241 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0014
2015-03-13 10:08:42,241 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from REMOVING to FINISHING
2015-03-13 10:08:42,342 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:42,343 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:42,344 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,534 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:42,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:42,706 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:42,707 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:42,708 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741991_1167
2015-03-13 10:08:42,708 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:42,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:43,095 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741994_1170
2015-03-13 10:08:43,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169
2015-03-13 10:08:43,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741995_1171
2015-03-13 10:08:43,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168
2015-03-13 10:08:43,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:43,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:43,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000007
2015-03-13 10:08:43,118 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:43,118 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:08:43,118 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000007
2015-03-13 10:08:43,119 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:08:43,119 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:43,119 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000007, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,119 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,119 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:43,120 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000007 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:08:43,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741986_1162 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:08:43,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741987_1163 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:08:43,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741988_1164 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:43,249 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741989_1165 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:08:43,250 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741991_1167 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:08:43,250 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741990_1166 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:43,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0014 dst=null perm=null
2015-03-13 10:08:43,277 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] starting step: (1/2) ...splatform/joingroupbyjoin
2015-03-13 10:08:43,284 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,291 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:43,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:43,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:43,308 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 15
2015-03-13 10:08:43,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=null
2015-03-13 10:08:43,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:43,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:08:43,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,315 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:43,316 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62005 dest: /127.0.0.1:60693
2015-03-13 10:08:43,318 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62006 dest: /127.0.0.1:60686
2015-03-13 10:08:43,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62007 dest: /127.0.0.1:60696
2015-03-13 10:08:43,323 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62007, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 2147000
2015-03-13 10:08:43,323 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,323 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,323 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62006, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 2581000
2015-03-13 10:08:43,324 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,324 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,324 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62005, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 3710000
2015-03-13 10:08:43,324 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,328 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741996_1172{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,328 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,329 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar
2015-03-13 10:08:43,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:43,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:43,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:43,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:08:43,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:08:43,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:08:43,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:08:43,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:08:43,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:43,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:43,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:43,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:43,338 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:43,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,341 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split
2015-03-13 10:08:43,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,342 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:43,343 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62008 dest: /127.0.0.1:60686
2015-03-13 10:08:43,345 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62009 dest: /127.0.0.1:60696
2015-03-13 10:08:43,346 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62010 dest: /127.0.0.1:60689
2015-03-13 10:08:43,347 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173 src: /127.0.0.1:62011 dest: /127.0.0.1:60693
2015-03-13 10:08:43,350 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62011, dest: /127.0.0.1:60693, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 1599000
2015-03-13 10:08:43,350 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,351 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,351 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62010, dest: /127.0.0.1:60689, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 2064000
2015-03-13 10:08:43,351 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,352 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62009, dest: /127.0.0.1:60696, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 3159000
2015-03-13 10:08:43,352 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,352 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,353 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62008, dest: /127.0.0.1:60686, bytes: 358, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 4376000
2015-03-13 10:08:43,353 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,354 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741997_1173{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:43,356 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,361 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:43,362 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62012 dest: /127.0.0.1:60693
2015-03-13 10:08:43,364 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62013 dest: /127.0.0.1:60686
2015-03-13 10:08:43,365 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174 src: /127.0.0.1:62014 dest: /127.0.0.1:60689
2015-03-13 10:08:43,368 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62014, dest: /127.0.0.1:60689, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 1321000
2015-03-13 10:08:43,368 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,369 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62013, dest: /127.0.0.1:60686, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 1652000
2015-03-13 10:08:43,369 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,369 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,369 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62012, dest: /127.0.0.1:60693, bytes: 44, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 2534000
2015-03-13 10:08:43,370 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,369 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,371 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741998_1174{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:43,372 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,372 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:1
2015-03-13 10:08:43,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:43,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:43,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:43,376 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:43,379 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:43,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62015 dest: /127.0.0.1:60693
2015-03-13 10:08:43,382 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62016 dest: /127.0.0.1:60686
2015-03-13 10:08:43,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175 src: /127.0.0.1:62017 dest: /127.0.0.1:60696
2015-03-13 10:08:43,386 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62017, dest: /127.0.0.1:60696, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 1429000
2015-03-13 10:08:43,386 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:43,386 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,386 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62016, dest: /127.0.0.1:60686, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 1693000
2015-03-13 10:08:43,387 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,387 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,387 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62015, dest: /127.0.0.1:60693, bytes: 98174, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 2339000
2015-03-13 10:08:43,387 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:43,388 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073741999_1175{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:43,389 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:43,389 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0015
2015-03-13 10:08:43,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=null
2015-03-13 10:08:43,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:43,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:43,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:43,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:43,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:43,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:43,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:43,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:43,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:43,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:43,400 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 15 submitted by user soberoi
2015-03-13 10:08:43,400 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0015
2015-03-13 10:08:43,400 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0015
2015-03-13 10:08:43,400 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0015
2015-03-13 10:08:43,400 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from NEW to NEW_SAVING
2015-03-13 10:08:43,401 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:43,401 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,401 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:43,401 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0015 from user: soberoi activated in queue: default
2015-03-13 10:08:43,401 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0015 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:43,401 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0015 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:43,402 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0015 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:43,402 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0015_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:43,402 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:43,402 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:43,404 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0015/
2015-03-13 10:08:43,405 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] submitted hadoop job: job_1426266260362_0015
2015-03-13 10:08:43,405 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper*joined] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0015/
2015-03-13 10:08:43,459 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:43,459 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:43,459 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:08:43,459 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0015 container=Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0015_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,459 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:43,459 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:43,459 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:43,460 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0015 AttemptId: appattempt_1426266260362_0015_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:08:43,460 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:43,460 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,460 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:43,461 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0015_000001
2015-03-13 10:08:43,461 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,461 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0015_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:08:43,463 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:43,465 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0015_01_000001 by user soberoi
2015-03-13 10:08:43,465 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0015
2015-03-13 10:08:43,465 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:43,465 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from NEW to INITING
2015-03-13 10:08:43,465 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0015_01_000001 to application application_1426266260362_0015
2015-03-13 10:08:43,465 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from INITING to RUNNING
2015-03-13 10:08:43,465 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0015_000001
2015-03-13 10:08:43,466 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:43,466 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:43,466 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0015
2015-03-13 10:08:43,466 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:43,466 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0015_01_000001
2015-03-13 10:08:43,477 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0015_01_000001.tokens. Credentials list:
2015-03-13 10:08:43,491 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:43,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0015_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001.tokens
2015-03-13 10:08:43,562 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:43,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:43,627 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 487000
2015-03-13 10:08:43,645 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:43,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:43,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:43,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62022, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 161000
2015-03-13 10:08:43,681 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:43,703 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 362, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 134000
2015-03-13 10:08:43,715 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:43,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:43,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:43,737 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62021, bytes: 98942, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1659101727_8055, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 238000
2015-03-13 10:08:43,750 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:43,750 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:43,775 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:43,775 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:43,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001/default_container_executor.sh]
2015-03-13 10:08:44,118 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:44,463 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:44,464 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:45,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:45,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:45,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED dst=null perm=null
2015-03-13 10:08:45,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:08:45,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_FAIL dst=null perm=null
2015-03-13 10:08:45,468 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:45,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=null
2015-03-13 10:08:45,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:08:45,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:08:45,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:45,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:45,839 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62024, bytes: 48, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174, duration: 168000
2015-03-13 10:08:45,853 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073741996_1172 to datanode(s) 127.0.0.1:60689
2015-03-13 10:08:45,853 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741990_1166, blk_1073741991_1167]
2015-03-13 10:08:45,854 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741991_1167]
2015-03-13 10:08:46,124 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:46,470 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:46,475 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 to 127.0.0.1:60689
2015-03-13 10:08:46,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:46,475 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:46,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:46,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:46,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:46,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:46,476 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:46,477 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:08:46,477 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:46,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62027 dest: /127.0.0.1:60689
2015-03-13 10:08:46,477 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:46,478 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:46,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:46,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:46,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172 src: /127.0.0.1:62027 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:08:46,479 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:46,480 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073741996_1172 size 254067
2015-03-13 10:08:46,605 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:46,606 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0015_000001
2015-03-13 10:08:46,606 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0015 APPATTEMPTID=appattempt_1426266260362_0015_000001
2015-03-13 10:08:46,607 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:46,607 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from ACCEPTED to RUNNING
2015-03-13 10:08:46,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:46,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:46,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:46,803 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:46,853 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62031 dest: /127.0.0.1:60686
2015-03-13 10:08:46,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62032 dest: /127.0.0.1:60693
2015-03-13 10:08:46,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176 src: /127.0.0.1:62033 dest: /127.0.0.1:60696
2015-03-13 10:08:46,864 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62033, dest: /127.0.0.1:60696, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 5155000
2015-03-13 10:08:46,864 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:46,864 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,864 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62032, dest: /127.0.0.1:60693, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 6045000
2015-03-13 10:08:46,865 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:46,865 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,865 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62031, dest: /127.0.0.1:60686, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 6850000
2015-03-13 10:08:46,865 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:46,866 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742000_1176{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:46,869 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:47,126 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:47,351 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:47,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,474 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:47,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:47,544 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,544 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:47,717 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:47,718 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741998_1174
2015-03-13 10:08:47,718 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,719 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:47,745 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:47,745 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:47,920 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:48,024 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:48,025 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:48,025 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:48,025 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0015 container=Container: [ContainerId: container_1426266260362_0015_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0015_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:48,025 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:08:48,025 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:48,102 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176
2015-03-13 10:08:48,103 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175
2015-03-13 10:08:48,103 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173
2015-03-13 10:08:48,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:48,304 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172
2015-03-13 10:08:48,381 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0014_01_000001 succeeded
2015-03-13 10:08:48,381 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:48,381 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014/container_1426266260362_0014_01_000001
2015-03-13 10:08:48,389 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:48,390 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0014_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:48,390 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0014_01_000001 from application application_1426266260362_0014
2015-03-13 10:08:48,390 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:48,390 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0014
2015-03-13 10:08:48,479 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:48,637 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:48,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:48,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:48,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:48,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:48,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:48,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:48,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:48,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:48,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:48,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:48,744 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:48,746 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0015_01_000002 by user soberoi
2015-03-13 10:08:48,746 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0015
2015-03-13 10:08:48,747 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:48,747 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from NEW to INITING
2015-03-13 10:08:48,747 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0015_01_000002 to application application_1426266260362_0015
2015-03-13 10:08:48,747 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from INITING to RUNNING
2015-03-13 10:08:48,747 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:48,747 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0015
2015-03-13 10:08:48,747 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0015
2015-03-13 10:08:48,747 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:48,748 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0015
2015-03-13 10:08:48,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:48,748 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:48,748 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0015_01_000002
2015-03-13 10:08:48,758 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0015_01_000002.tokens. Credentials list:
2015-03-13 10:08:48,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:48,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0015_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002.tokens
2015-03-13 10:08:48,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:48,855 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166]
2015-03-13 10:08:48,855 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741986_1162, blk_1073741987_1163, blk_1073741988_1164, blk_1073741989_1165, blk_1073741990_1166, blk_1073741991_1167]
2015-03-13 10:08:48,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:48,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:48,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar dst=null perm=null
2015-03-13 10:08:48,902 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62037, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1931043022_8158, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741996_1172, duration: 535000
2015-03-13 10:08:48,922 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:48,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:48,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:48,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml dst=null perm=null
2015-03-13 10:08:48,947 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62038, bytes: 98942, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1931043022_8158, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741999_1175, duration: 294000
2015-03-13 10:08:48,960 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:48,960 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:48,985 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:48,985 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:49,024 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:49,024 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:49,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002/default_container_executor.sh]
2015-03-13 10:08:49,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 14 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:49,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0014_01_000001
2015-03-13 10:08:49,131 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0014_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:49,131 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0014_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:49,131 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0014_000001
2015-03-13 10:08:49,132 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0014 CONTAINERID=container_1426266260362_0014_01_000001
2015-03-13 10:08:49,132 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0014_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:49,132 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0014_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:49,132 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0014 State change from FINISHING to FINISHED
2015-03-13 10:08:49,132 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:08:49,132 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0014
2015-03-13 10:08:49,132 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0014_000001
2015-03-13 10:08:49,132 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0014_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:49,132 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:49,133 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=2, numContainers=2
2015-03-13 10:08:49,133 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0014_000001 released container container_1426266260362_0014_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:49,132 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0014,name=[6DC799D3695A41EDB24861BDF4BA2FF4/561BA7C30D2E4E9290533DB9645A592A] lower*upper*joined/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0014/jobhistory/job/job_1426266260362_0014,appMasterHost=Edinburgh.local,startTime=1426266501740,finishTime=1426266522241,finalStatus=SUCCEEDED
2015-03-13 10:08:49,133 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0014_000001 is done. finalState=FINISHED
2015-03-13 10:08:49,133 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0014 requests cleared
2015-03-13 10:08:49,133 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0014 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:49,133 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0014 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:49,135 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0014_000001 (auth:SIMPLE)
2015-03-13 10:08:49,136 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0014_01_000001
2015-03-13 10:08:49,483 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:49,650 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:49,651 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991 for deletion
2015-03-13 10:08:49,651 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:49,652 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741991_1167 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741991
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986 for deletion
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987 for deletion
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988 for deletion
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989 for deletion
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741987_1163 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741987
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990 for deletion
2015-03-13 10:08:49,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741986_1162 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741986
2015-03-13 10:08:49,852 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741989_1165 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741989
2015-03-13 10:08:49,852 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741988_1164 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741988
2015-03-13 10:08:49,852 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741990_1166 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741990
2015-03-13 10:08:50,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:50,025 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:50,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,025 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,026 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0014
2015-03-13 10:08:50,026 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:50,026 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0014, with delay of 10800 seconds
2015-03-13 10:08:50,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,026 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,133 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:50,133 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0014
2015-03-13 10:08:50,134 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0014 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:50,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0014, with delay of 10800 seconds
2015-03-13 10:08:50,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0014
2015-03-13 10:08:50,485 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job.split dst=null perm=null
2015-03-13 10:08:51,259 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62042, bytes: 362, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741997_1173, duration: 126000
2015-03-13 10:08:51,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000 dst=null perm=null
2015-03-13 10:08:51,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A/part-00000 dst=null perm=null
2015-03-13 10:08:51,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62043, bytes: 244, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741992_1168, duration: 135000
2015-03-13 10:08:51,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,490 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:51,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=null
2015-03-13 10:08:51,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=null
2015-03-13 10:08:51,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower+upper.txt dst=null perm=null
2015-03-13 10:08:51,503 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62044, bytes: 34, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741985_1161, duration: 162000
2015-03-13 10:08:51,524 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,553 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62045 dest: /127.0.0.1:60693
2015-03-13 10:08:51,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62046 dest: /127.0.0.1:60689
2015-03-13 10:08:51,556 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177 src: /127.0.0.1:62047 dest: /127.0.0.1:60696
2015-03-13 10:08:51,563 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62047, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 4878000
2015-03-13 10:08:51,563 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,563 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,564 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62046, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 5560000
2015-03-13 10:08:51,564 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,565 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62045, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 6739000
2015-03-13 10:08:51,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,565 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742001_1177{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,569 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0015_m_000000_0_1911358585_1
2015-03-13 10:08:51,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0 dst=null perm=null
2015-03-13 10:08:51,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0 dst=null perm=null
2015-03-13 10:08:51,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000 dst=null perm=null
2015-03-13 10:08:51,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/_temporary/attempt_1426266260362_0015_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:51,600 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0015_01_000002
2015-03-13 10:08:51,600 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:51,601 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:08:51,601 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0015_01_000002
2015-03-13 10:08:51,601 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:08:51,610 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0015_01_000002 is : 143
2015-03-13 10:08:51,621 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,622 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:08:51,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,623 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62048 dest: /127.0.0.1:60686
2015-03-13 10:08:51,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,623 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:51,624 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:08:51,624 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0015_01_000002 from application application_1426266260362_0015
2015-03-13 10:08:51,624 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:51,624 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0015
2015-03-13 10:08:51,624 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000002
2015-03-13 10:08:51,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62049 dest: /127.0.0.1:60689
2015-03-13 10:08:51,626 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178 src: /127.0.0.1:62050 dest: /127.0.0.1:60696
2015-03-13 10:08:51,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1 dst=null perm=null
2015-03-13 10:08:51,633 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist for DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:51,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:51,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000 dst=null perm=null
2015-03-13 10:08:51,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2015-03-13 10:08:51,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary/1/task_1426266260362_0015_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary dst=null perm=null
2015-03-13 10:08:51,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,655 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,659 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,672 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62050, dest: /127.0.0.1:60696, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 43050000
2015-03-13 10:08:51,672 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,675 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,676 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62049, dest: /127.0.0.1:60689, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 46704000
2015-03-13 10:08:51,676 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,676 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,676 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62048, dest: /127.0.0.1:60686, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 47592000
2015-03-13 10:08:51,677 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,677 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742002_1178{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,678 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,682 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:51,684 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62051 dest: /127.0.0.1:60696
2015-03-13 10:08:51,685 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62052 dest: /127.0.0.1:60689
2015-03-13 10:08:51,687 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179 src: /127.0.0.1:62053 dest: /127.0.0.1:60693
2015-03-13 10:08:51,689 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62053, dest: /127.0.0.1:60693, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 1520000
2015-03-13 10:08:51,690 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,690 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,690 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62052, dest: /127.0.0.1:60689, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 1957000
2015-03-13 10:08:51,690 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,691 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,691 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62051, dest: /127.0.0.1:60696, bytes: 446, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 2850000
2015-03-13 10:08:51,691 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,692 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742003_1179{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:51,693 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist dst=null perm=null
2015-03-13 10:08:51,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:51,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist dst=null perm=null
2015-03-13 10:08:51,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:08:51,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1.jhist dst=null perm=null
2015-03-13 10:08:51,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62054, bytes: 23277, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178, duration: 149000
2015-03-13 10:08:51,712 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:51,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62055 dest: /127.0.0.1:60693
2015-03-13 10:08:51,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62056 dest: /127.0.0.1:60696
2015-03-13 10:08:51,716 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180 src: /127.0.0.1:62057 dest: /127.0.0.1:60689
2015-03-13 10:08:51,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62057, dest: /127.0.0.1:60689, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 1328000
2015-03-13 10:08:51,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,719 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62056, dest: /127.0.0.1:60696, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 1781000
2015-03-13 10:08:51,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,720 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,720 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62055, dest: /127.0.0.1:60693, bytes: 23093, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, duration: 2542000
2015-03-13 10:08:51,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,721 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742004_1180{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:51,722 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml dst=null perm=null
2015-03-13 10:08:51,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:51,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml dst=null perm=null
2015-03-13 10:08:51,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp dst=null perm=null
2015-03-13 10:08:51,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015/job_1426266260362_0015_1_conf.xml dst=null perm=null
2015-03-13 10:08:51,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:51,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62058, bytes: 91707, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742000_1176, duration: 250000
2015-03-13 10:08:51,737 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:51,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62059 dest: /127.0.0.1:60689
2015-03-13 10:08:51,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62060 dest: /127.0.0.1:60686
2015-03-13 10:08:51,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181 src: /127.0.0.1:62061 dest: /127.0.0.1:60696
2015-03-13 10:08:51,744 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62061, dest: /127.0.0.1:60696, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 1897000
2015-03-13 10:08:51,744 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:51,744 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,745 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62060, dest: /127.0.0.1:60686, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 2416000
2015-03-13 10:08:51,745 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,745 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,746 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62059, dest: /127.0.0.1:60689, bytes: 90995, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1318542119_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, duration: 3172000
2015-03-13 10:08:51,746 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:51,746 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742005_1181{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:51,748 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1318542119_1
2015-03-13 10:08:51,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:08:51,761 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from RUNNING to FINISHING
2015-03-13 10:08:51,761 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0015
2015-03-13 10:08:51,761 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from RUNNING to REMOVING
2015-03-13 10:08:51,761 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0015
2015-03-13 10:08:51,762 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from REMOVING to FINISHING
2015-03-13 10:08:52,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:52,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:52,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:52,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:52,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:52,495 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:52,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:08:52,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0015_01_000002
2015-03-13 10:08:52,608 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:52,608 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0015_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:08:52,608 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000002
2015-03-13 10:08:52,608 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0015_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:52,608 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:08:52,608 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0015_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:52,609 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:52,609 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:08:52,609 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0015_000001 released container container_1426266260362_0015_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:52,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:52,751 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:52,752 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:52,768 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741996_1172 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:08:52,768 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741997_1173 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:08:52,768 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741998_1174 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:08:52,769 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741999_1175 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:08:52,769 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742002_1178 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:08:52,769 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742000_1176 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:08:52,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0015 dst=null perm=null
2015-03-13 10:08:52,796 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741992_1168 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:08:52,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2463283610_lower_upper_7CE7EFE8013A4AD39F74615BC414DB0A dst=null perm=null
2015-03-13 10:08:52,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,798 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary
2015-03-13 10:08:52,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/_temporary dst=null perm=null
2015-03-13 10:08:52,805 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,806 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,809 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2015-03-13 10:08:52,811 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 214000
2015-03-13 10:08:52,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,818 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,821 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2015-03-13 10:08:52,823 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 172000
2015-03-13 10:08:52,823 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin
2015-03-13 10:08:52,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin dst=null perm=null
2015-03-13 10:08:52,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2015-03-13 10:08:52,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joingroupbyjoin/part-00000 dst=null perm=null
2015-03-13 10:08:52,827 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 74, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177, duration: 156000
2015-03-13 10:08:52,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:08:52,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:08:52,837 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,838 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:08:52,838 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:08:52,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:08:52,848 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting
2015-03-13 10:08:52,848 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:08:52,848 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:08:52,849 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross"]
2015-03-13 10:08:52,849 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] parallel execution is enabled: true
2015-03-13 10:08:52,849 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting jobs: 1
2015-03-13 10:08:52,849 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] allocating threads: 1
2015-03-13 10:08:52,850 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/1) ...ieldedpipesplatform/cross
2015-03-13 10:08:52,859 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,867 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:08:52,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:52,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:52,871 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 16
2015-03-13 10:08:52,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=null
2015-03-13 10:08:52,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:08:52,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:08:52,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:52,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,877 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:08:52,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62063 dest: /127.0.0.1:60693
2015-03-13 10:08:52,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62064 dest: /127.0.0.1:60696
2015-03-13 10:08:52,880 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62065 dest: /127.0.0.1:60689
2015-03-13 10:08:52,884 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62065, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 2724000
2015-03-13 10:08:52,884 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,885 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,885 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62064, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 2629000
2015-03-13 10:08:52,885 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,885 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,886 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62063, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 3570000
2015-03-13 10:08:52,886 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742006_1182{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:08:52,888 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,888 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar
2015-03-13 10:08:52,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:52,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:52,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:52,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:52,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:08:52,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:08:52,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:08:52,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:08:52,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:08:52,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:52,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:08:52,896 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:08:52,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:08:52,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,900 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split
2015-03-13 10:08:52,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:52,902 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:52,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62066 dest: /127.0.0.1:60689
2015-03-13 10:08:52,905 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62067 dest: /127.0.0.1:60693
2015-03-13 10:08:52,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62068 dest: /127.0.0.1:60686
2015-03-13 10:08:52,908 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183 src: /127.0.0.1:62069 dest: /127.0.0.1:60696
2015-03-13 10:08:52,910 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62069, dest: /127.0.0.1:60696, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 1459000
2015-03-13 10:08:52,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,911 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,911 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62068, dest: /127.0.0.1:60686, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 1845000
2015-03-13 10:08:52,911 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,912 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,912 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62067, dest: /127.0.0.1:60693, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 2639000
2015-03-13 10:08:52,912 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,912 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,913 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62066, dest: /127.0.0.1:60689, bytes: 1419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 3524000
2015-03-13 10:08:52,913 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,916 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742007_1183{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,917 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,921 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,922 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:08:52,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62070 dest: /127.0.0.1:60696
2015-03-13 10:08:52,924 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62071 dest: /127.0.0.1:60689
2015-03-13 10:08:52,925 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:52,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184 src: /127.0.0.1:62072 dest: /127.0.0.1:60686
2015-03-13 10:08:52,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:52,927 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:52,928 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62072, dest: /127.0.0.1:60686, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 1067000
2015-03-13 10:08:52,928 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,928 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,928 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62071, dest: /127.0.0.1:60689, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 1219000
2015-03-13 10:08:52,929 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,929 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,929 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62070, dest: /127.0.0.1:60696, bytes: 148, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 2205000
2015-03-13 10:08:52,930 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,930 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742008_1184{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:08:52,931 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,931 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:4
2015-03-13 10:08:52,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:08:52,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:08:52,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:08:52,935 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:08:52,939 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:08:52,940 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62073 dest: /127.0.0.1:60689
2015-03-13 10:08:52,941 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62074 dest: /127.0.0.1:60693
2015-03-13 10:08:52,942 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185 src: /127.0.0.1:62075 dest: /127.0.0.1:60696
2015-03-13 10:08:52,945 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62075, dest: /127.0.0.1:60696, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 1595000
2015-03-13 10:08:52,945 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:52,945 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,945 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62074, dest: /127.0.0.1:60693, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 2109000
2015-03-13 10:08:52,946 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,946 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,946 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62073, dest: /127.0.0.1:60689, bytes: 97486, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 2815000
2015-03-13 10:08:52,947 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:52,948 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742009_1185{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:08:52,949 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:08:52,949 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0016
2015-03-13 10:08:52,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=null
2015-03-13 10:08:52,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:52,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:52,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:52,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:52,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:52,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:52,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:52,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:52,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:52,970 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:52,971 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:52,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:52,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:52,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:52,975 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 16 submitted by user soberoi
2015-03-13 10:08:52,975 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0016
2015-03-13 10:08:52,975 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0016
2015-03-13 10:08:52,975 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0016
2015-03-13 10:08:52,975 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from NEW to NEW_SAVING
2015-03-13 10:08:52,976 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:08:52,976 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0016_000001
2015-03-13 10:08:52,976 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from NEW to SUBMITTED
2015-03-13 10:08:52,976 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0016 from user: soberoi activated in queue: default
2015-03-13 10:08:52,976 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0016 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:08:52,976 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0016 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:08:52,977 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0016_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:08:52,977 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0016 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:08:52,977 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:08:52,977 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from SUBMITTED to ACCEPTED
2015-03-13 10:08:52,979 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0016/
2015-03-13 10:08:52,979 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0016
2015-03-13 10:08:52,979 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0016/
2015-03-13 10:08:53,139 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:53,139 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:08:53,139 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:08:53,139 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0016_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:53,140 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:08:53,140 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:53,140 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:53,141 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0016 AttemptId: appattempt_1426266260362_0016_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:08:53,141 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:08:53,141 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,141 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:08:53,142 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0016_000001
2015-03-13 10:08:53,142 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,142 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0016_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:08:53,145 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:53,146 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000001 by user soberoi
2015-03-13 10:08:53,146 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0016
2015-03-13 10:08:53,146 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:08:53,147 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from NEW to INITING
2015-03-13 10:08:53,147 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000001 to application application_1426266260362_0016
2015-03-13 10:08:53,147 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from INITING to RUNNING
2015-03-13 10:08:53,147 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0016_000001
2015-03-13 10:08:53,147 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:08:53,147 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:08:53,147 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:53,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:53,148 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000001
2015-03-13 10:08:53,158 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0016_01_000001.tokens. Credentials list:
2015-03-13 10:08:53,174 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:53,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0016_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001.tokens
2015-03-13 10:08:53,244 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:53,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:53,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:53,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:53,310 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742004_1180
2015-03-13 10:08:53,310 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:53,311 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742002_1178
2015-03-13 10:08:53,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742005_1181
2015-03-13 10:08:53,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179
2015-03-13 10:08:53,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:53,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742001_1177
2015-03-13 10:08:53,313 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:53,316 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 487000
2015-03-13 10:08:53,334 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:53,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:53,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:53,367 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62079, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 167000
2015-03-13 10:08:53,379 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:53,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:53,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:08:53,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62062, bytes: 1431, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 177000
2015-03-13 10:08:53,415 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:53,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:53,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:53,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62079, bytes: 98250, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1879701091_8313, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 274000
2015-03-13 10:08:53,449 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:53,449 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:53,474 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:53,475 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:53,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:53,513 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:53,541 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001/default_container_executor.sh]
2015-03-13 10:08:54,139 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:54,139 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:54,504 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:54,860 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742006_1182 to datanode(s) 127.0.0.1:60686
2015-03-13 10:08:54,860 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742000_1176, blk_1073742002_1178, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174, blk_1073741999_1175]
2015-03-13 10:08:54,860 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742000_1176, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174, blk_1073741999_1175]
2015-03-13 10:08:55,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:08:55,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED dst=null perm=null
2015-03-13 10:08:55,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:08:55,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_FAIL dst=null perm=null
2015-03-13 10:08:55,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:55,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=null
2015-03-13 10:08:55,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:08:55,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:08:55,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:55,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.splitmetainfo dst=null perm=null
2015-03-13 10:08:55,483 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:55,483 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 to 127.0.0.1:60686
2015-03-13 10:08:55,483 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:55,483 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:55,483 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:55,484 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:55,485 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:55,485 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:08:55,485 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:55,485 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62081 dest: /127.0.0.1:60686
2015-03-13 10:08:55,485 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:55,485 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:55,487 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182 src: /127.0.0.1:62081 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:08:55,487 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742006_1182 size 254067
2015-03-13 10:08:55,508 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:55,536 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62082, bytes: 152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184, duration: 186000
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:55,657 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:56,149 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:56,290 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:56,292 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0016_000001
2015-03-13 10:08:56,292 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0016 APPATTEMPTID=appattempt_1426266260362_0016_000001
2015-03-13 10:08:56,292 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:08:56,292 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from ACCEPTED to RUNNING
2015-03-13 10:08:56,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:56,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:08:56,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:08:56,506 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:08:56,511 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:56,544 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62088 dest: /127.0.0.1:60696
2015-03-13 10:08:56,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62089 dest: /127.0.0.1:60689
2015-03-13 10:08:56,547 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186 src: /127.0.0.1:62090 dest: /127.0.0.1:60693
2015-03-13 10:08:56,556 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62090, dest: /127.0.0.1:60693, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 6782000
2015-03-13 10:08:56,556 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:08:56,557 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62089, dest: /127.0.0.1:60689, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 7637000
2015-03-13 10:08:56,557 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,557 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:56,558 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62088, dest: /127.0.0.1:60696, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 8661000
2015-03-13 10:08:56,558 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:08:56,559 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,559 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742010_1186{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:08:56,562 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:08:57,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:57,370 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:57,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:57,372 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:57,516 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:57,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,517 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:08:57,517 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:08:57,518 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,518 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:08:57,518 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,519 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:08:57,519 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:08:57,519 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,519 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:08:57,519 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,520 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,520 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:08:57,520 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:08:57,520 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:08:57,521 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:08:57,521 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:08:57,521 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:08:57,521 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0016 container=Container: [ContainerId: container_1426266260362_0016_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0016_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,521 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:08:57,522 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:57,575 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:57,575 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:57,756 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185
2015-03-13 10:08:57,756 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183
2015-03-13 10:08:57,758 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:57,864 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742000_1176, blk_1073742002_1178, blk_1073741992_1168, blk_1073741996_1172, blk_1073741997_1173, blk_1073741999_1175]
2015-03-13 10:08:57,864 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742002_1178, blk_1073741996_1172, blk_1073741997_1173, blk_1073741998_1174]
2015-03-13 10:08:57,898 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0015_01_000001 succeeded
2015-03-13 10:08:57,898 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:08:57,898 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0015_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:08:57,906 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0015_01_000001 from application application_1426266260362_0015
2015-03-13 10:08:57,906 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:57,906 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0015
2015-03-13 10:08:57,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,906 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015/container_1426266260362_0015_01_000001
2015-03-13 10:08:57,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:57,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742008_1184
2015-03-13 10:08:57,959 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182
2015-03-13 10:08:58,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,326 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:08:58,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:58,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:58,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:58,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:58,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:58,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:58,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:58,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:58,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:08:58,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:08:58,447 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:08:58,449 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000002 by user soberoi
2015-03-13 10:08:58,449 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000004 by user soberoi
2015-03-13 10:08:58,450 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0016
2015-03-13 10:08:58,450 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:08:58,449 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000005 by user soberoi
2015-03-13 10:08:58,449 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0016_01_000003 by user soberoi
2015-03-13 10:08:58,450 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:08:58,450 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:08:58,450 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000004 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from NEW to INITING
2015-03-13 10:08:58,450 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:08:58,451 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000002 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000005 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0016_01_000003 to application application_1426266260362_0016
2015-03-13 10:08:58,451 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from INITING to RUNNING
2015-03-13 10:08:58,451 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:08:58,452 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,452 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,452 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,452 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,453 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:08:58,453 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,453 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,453 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,453 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,454 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,454 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0016
2015-03-13 10:08:58,454 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:08:58,454 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0016
2015-03-13 10:08:58,454 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000002
2015-03-13 10:08:58,455 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000004
2015-03-13 10:08:58,456 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000003
2015-03-13 10:08:58,457 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0016_01_000005
2015-03-13 10:08:58,473 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000004.tokens. Credentials list:
2015-03-13 10:08:58,474 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000002.tokens. Credentials list:
2015-03-13 10:08:58,474 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0016_01_000005.tokens. Credentials list:
2015-03-13 10:08:58,474 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0016_01_000003.tokens. Credentials list:
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998 for deletion
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:58,486 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741998_1174 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741998
2015-03-13 10:08:58,487 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:58,489 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:58,516 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186
2015-03-13 10:08:58,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 15 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:08:58,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,517 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0015_01_000001
2015-03-13 10:08:58,518 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,518 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:58,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0015_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:08:58,518 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0015_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:08:58,518 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0015 CONTAINERID=container_1426266260362_0015_01_000001
2015-03-13 10:08:58,518 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0015_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:08:58,518 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0015_000001
2015-03-13 10:08:58,518 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0015_000001 State change from FINISHING to FINISHED
2015-03-13 10:08:58,518 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:08:58,519 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0015 State change from FINISHING to FINISHED
2015-03-13 10:08:58,519 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0015_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:58,519 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0015_000001
2015-03-13 10:08:58,519 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0015
2015-03-13 10:08:58,519 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0015,name=[6DC799D3695A41EDB24861BDF4BA2FF4/3066B2C3CE37414884C03F0C08B36832] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0015/jobhistory/job/job_1426266260362_0015,appMasterHost=Edinburgh.local,startTime=1426266523400,finishTime=1426266531762,finalStatus=SUCCEEDED
2015-03-13 10:08:58,519 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:08:58,519 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:08:58,519 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0015_000001 released container container_1426266260362_0015_01_000001 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:08:58,519 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0015_000001 is done. finalState=FINISHED
2015-03-13 10:08:58,520 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0015 requests cleared
2015-03-13 10:08:58,520 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0015 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:08:58,520 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0015 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:08:58,520 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,520 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:08:58,522 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0015_000001 (auth:SIMPLE)
2015-03-13 10:08:58,523 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0015_01_000001
2015-03-13 10:08:58,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004.tokens
2015-03-13 10:08:58,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:58,610 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:58,611 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,611 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0015
2015-03-13 10:08:58,611 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:58,611 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0015, with delay of 10800 seconds
2015-03-13 10:08:58,611 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,611 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,612 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:58,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:58,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:58,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar dst=null perm=null
2015-03-13 10:08:58,631 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62095, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1949850480_8425, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742006_1182, duration: 465000
2015-03-13 10:08:58,651 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:58,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:58,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:58,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml dst=null perm=null
2015-03-13 10:08:58,674 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62096, bytes: 98250, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1949850480_8425, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742009_1185, duration: 277000
2015-03-13 10:08:58,686 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:08:58,686 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,687 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:08:58,727 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,727 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,732 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,733 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,733 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:08:58,733 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:08:58,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004/default_container_executor.sh]
2015-03-13 10:08:58,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002/default_container_executor.sh]
2015-03-13 10:08:58,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005/default_container_executor.sh]
2015-03-13 10:08:58,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003/default_container_executor.sh]
2015-03-13 10:08:58,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000 for deletion
2015-03-13 10:08:58,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002 for deletion
2015-03-13 10:08:58,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992 for deletion
2015-03-13 10:08:58,857 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996 for deletion
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997 for deletion
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999 for deletion
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742000_1176 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742000
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742002_1178 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742002
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741992_1168 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741992
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741996_1172 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741996
2015-03-13 10:08:58,859 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741999_1175 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741999
2015-03-13 10:08:58,858 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741997_1173 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741997
2015-03-13 10:08:59,155 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,341 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:08:59,519 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,519 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:08:59,519 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,520 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0015
2015-03-13 10:08:59,520 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0015 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:08:59,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0015
2015-03-13 10:08:59,520 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0015, with delay of 10800 seconds
2015-03-13 10:08:59,520 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:08:59,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:08:59,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0016_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003.tokens
2015-03-13 10:08:59,830 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:08:59,937 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:00,076 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0016_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005.tokens
2015-03-13 10:09:00,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:00,157 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:00,308 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0016_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002.tokens
2015-03-13 10:09:00,309 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:00,524 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:00,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,158 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,528 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:01,529 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,160 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,531 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,531 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,532 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:02,532 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,164 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,532 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:03,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:04,537 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:09:05,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:09:05,153 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62107, bytes: 399, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 128000
2015-03-13 10:09:05,169 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:09:05,275 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62109, bytes: 1431, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 151000
2015-03-13 10:09:05,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job.split dst=null perm=null
2015-03-13 10:09:05,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:05,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62111, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 176000
2015-03-13 10:09:05,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,404 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62112, bytes: 915, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 156000
2015-03-13 10:09:05,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:05,421 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62114, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 156000
2015-03-13 10:09:05,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,446 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62113, bytes: 1431, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742007_1183, duration: 169000
2015-03-13 10:09:05,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:05,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62115, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 154000
2015-03-13 10:09:05,542 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,542 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,543 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,543 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:05,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:05,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,717 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62107, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 148000
2015-03-13 10:09:05,766 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:05,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,808 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62116 dest: /127.0.0.1:60689
2015-03-13 10:09:05,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,810 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62117 dest: /127.0.0.1:60686
2015-03-13 10:09:05,811 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187 src: /127.0.0.1:62118 dest: /127.0.0.1:60696
2015-03-13 10:09:05,815 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62109, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 135000
2015-03-13 10:09:05,819 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62118, dest: /127.0.0.1:60696, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 6640000
2015-03-13 10:09:05,820 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:05,820 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,820 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62117, dest: /127.0.0.1:60686, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 7527000
2015-03-13 10:09:05,821 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,821 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,821 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62116, dest: /127.0.0.1:60689, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 8390000
2015-03-13 10:09:05,821 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,822 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742011_1187{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:05,826 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0016_m_000003_0_363385392_1
2015-03-13 10:09:05,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0 dst=null perm=null
2015-03-13 10:09:05,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0 dst=null perm=null
2015-03-13 10:09:05,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003 dst=null perm=null
2015-03-13 10:09:05,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:05,848 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:05,867 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:05,867 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000005
2015-03-13 10:09:05,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,868 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,868 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:05,880 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000005 is : 143
2015-03-13 10:09:05,882 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:05,884 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62120 dest: /127.0.0.1:60686
2015-03-13 10:09:05,885 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62121 dest: /127.0.0.1:60696
2015-03-13 10:09:05,887 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189 src: /127.0.0.1:62122 dest: /127.0.0.1:60693
2015-03-13 10:09:05,891 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist for DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:05,894 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:05,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,895 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000005
2015-03-13 10:09:05,896 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,896 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:05,896 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000005 from application application_1426266260362_0016
2015-03-13 10:09:05,896 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:05,896 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:05,915 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62119 dest: /127.0.0.1:60686
2015-03-13 10:09:05,917 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62123 dest: /127.0.0.1:60693
2015-03-13 10:09:05,918 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188 src: /127.0.0.1:62124 dest: /127.0.0.1:60689
2015-03-13 10:09:05,928 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62124, dest: /127.0.0.1:60689, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 8117000
2015-03-13 10:09:05,928 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:05,929 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,929 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62123, dest: /127.0.0.1:60693, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 8935000
2015-03-13 10:09:05,929 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,930 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,930 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62119, dest: /127.0.0.1:60686, bytes: 56, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 9703000
2015-03-13 10:09:05,930 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:05,930 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742012_1188{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:05,935 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0016_m_000001_0_-1252421238_1
2015-03-13 10:09:05,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0 dst=null perm=null
2015-03-13 10:09:05,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0 dst=null perm=null
2015-03-13 10:09:05,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001 dst=null perm=null
2015-03-13 10:09:05,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:05,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:05,961 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62112, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 151000
2015-03-13 10:09:05,965 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000003
2015-03-13 10:09:05,965 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:05,965 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:05,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,966 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000003
2015-03-13 10:09:05,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:05,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:05,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:05,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000005
2015-03-13 10:09:05,967 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:05,967 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:05,967 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000005
2015-03-13 10:09:05,967 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:09:05,967 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:05,967 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:05,967 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:05,967 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:05,967 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000005 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:09:05,978 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000003 is : 143
2015-03-13 10:09:05,991 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:05,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000003
2015-03-13 10:09:05,994 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:05,994 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:05,994 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000003 from application application_1426266260362_0016
2015-03-13 10:09:05,994 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:05,994 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,007 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:06,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62125 dest: /127.0.0.1:60693
2015-03-13 10:09:06,050 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62126 dest: /127.0.0.1:60689
2015-03-13 10:09:06,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190 src: /127.0.0.1:62127 dest: /127.0.0.1:60696
2015-03-13 10:09:06,059 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62127, dest: /127.0.0.1:60696, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 6342000
2015-03-13 10:09:06,060 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,060 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62126, dest: /127.0.0.1:60689, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 7090000
2015-03-13 10:09:06,060 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,060 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,061 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62125, dest: /127.0.0.1:60693, bytes: 72, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 8017000
2015-03-13 10:09:06,061 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,061 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742014_1190{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,061 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:06,066 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0016_m_000002_0_-1227443263_1
2015-03-13 10:09:06,073 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:06,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0 dst=null perm=null
2015-03-13 10:09:06,076 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:06,081 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62128, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 152000
2015-03-13 10:09:06,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0 dst=null perm=null
2015-03-13 10:09:06,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002 dst=null perm=null
2015-03-13 10:09:06,086 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62129, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 147000
2015-03-13 10:09:06,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:06,097 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000004
2015-03-13 10:09:06,097 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:06,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:06,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000003
2015-03-13 10:09:06,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:06,099 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000004
2015-03-13 10:09:06,099 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:06,100 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:06,100 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000003
2015-03-13 10:09:06,100 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:06,100 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:06,100 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,100 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,100 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:06,100 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000003 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:06,108 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:06,112 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000004 is : 143
2015-03-13 10:09:06,124 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:06,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000004
2015-03-13 10:09:06,127 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,128 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:06,128 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000004 from application application_1426266260362_0016
2015-03-13 10:09:06,128 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:06,128 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62130 dest: /127.0.0.1:60693
2015-03-13 10:09:06,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62131 dest: /127.0.0.1:60696
2015-03-13 10:09:06,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191 src: /127.0.0.1:62132 dest: /127.0.0.1:60689
2015-03-13 10:09:06,169 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62132, dest: /127.0.0.1:60689, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 9808000
2015-03-13 10:09:06,169 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,170 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,170 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62131, dest: /127.0.0.1:60696, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 10696000
2015-03-13 10:09:06,170 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,170 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,171 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62130, dest: /127.0.0.1:60693, bytes: 96, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 11422000
2015-03-13 10:09:06,171 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,171 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742015_1191{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,175 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,175 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0016_m_000000_0_1697196325_1
2015-03-13 10:09:06,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0 dst=null perm=null
2015-03-13 10:09:06,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0 dst=null perm=null
2015-03-13 10:09:06,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000 dst=null perm=null
2015-03-13 10:09:06,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/_temporary/attempt_1426266260362_0016_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:06,200 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:06,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:06,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:06,201 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000002
2015-03-13 10:09:06,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000004
2015-03-13 10:09:06,202 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:06,202 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:06,202 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000004
2015-03-13 10:09:06,202 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:06,202 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:06,202 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,203 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:06,203 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:06,203 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000004 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:06,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,207 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1 dst=null perm=null
2015-03-13 10:09:06,217 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0016_01_000002 is : 143
2015-03-13 10:09:06,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000 dst=null perm=null
2015-03-13 10:09:06,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2015-03-13 10:09:06,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001 dst=null perm=null
2015-03-13 10:09:06,229 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:06,229 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,229 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2015-03-13 10:09:06,230 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000002
2015-03-13 10:09:06,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,232 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:06,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,232 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:06,233 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000002 from application application_1426266260362_0016
2015-03-13 10:09:06,233 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:06,233 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:06,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002 dst=null perm=null
2015-03-13 10:09:06,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2015-03-13 10:09:06,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:06,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003 dst=null perm=null
2015-03-13 10:09:06,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2015-03-13 10:09:06,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary/1/task_1426266260362_0016_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary dst=null perm=null
2015-03-13 10:09:06,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,254 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,258 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,269 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62122, dest: /127.0.0.1:60693, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 381423000
2015-03-13 10:09:06,270 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,270 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,271 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62121, dest: /127.0.0.1:60696, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 382304000
2015-03-13 10:09:06,271 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,272 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,272 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62120, dest: /127.0.0.1:60686, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 383808000
2015-03-13 10:09:06,272 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,273 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742013_1189{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,274 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,278 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:06,280 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62133 dest: /127.0.0.1:60686
2015-03-13 10:09:06,283 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62134 dest: /127.0.0.1:60689
2015-03-13 10:09:06,284 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192 src: /127.0.0.1:62135 dest: /127.0.0.1:60696
2015-03-13 10:09:06,287 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62135, dest: /127.0.0.1:60696, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 1360000
2015-03-13 10:09:06,287 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,288 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62134, dest: /127.0.0.1:60689, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 1918000
2015-03-13 10:09:06,288 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,288 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,289 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62133, dest: /127.0.0.1:60686, bytes: 436, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 2807000
2015-03-13 10:09:06,289 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,289 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742016_1192{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:06,290 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist dst=null perm=null
2015-03-13 10:09:06,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:06,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist dst=null perm=null
2015-03-13 10:09:06,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:06,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1.jhist dst=null perm=null
2015-03-13 10:09:06,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,310 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62136, bytes: 46771, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189, duration: 173000
2015-03-13 10:09:06,311 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:06,313 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62137 dest: /127.0.0.1:60696
2015-03-13 10:09:06,314 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62138 dest: /127.0.0.1:60686
2015-03-13 10:09:06,315 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193 src: /127.0.0.1:62139 dest: /127.0.0.1:60689
2015-03-13 10:09:06,318 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62139, dest: /127.0.0.1:60689, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 1391000
2015-03-13 10:09:06,318 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,319 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,319 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62138, dest: /127.0.0.1:60686, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 1879000
2015-03-13 10:09:06,319 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,319 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,320 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62137, dest: /127.0.0.1:60696, bytes: 46407, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, duration: 2644000
2015-03-13 10:09:06,320 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,320 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742017_1193{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:06,322 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml dst=null perm=null
2015-03-13 10:09:06,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:06,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml dst=null perm=null
2015-03-13 10:09:06,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:06,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016/job_1426266260362_0016_1_conf.xml dst=null perm=null
2015-03-13 10:09:06,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:06,334 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62140, bytes: 91015, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742010_1186, duration: 246000
2015-03-13 10:09:06,336 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:06,338 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62141 dest: /127.0.0.1:60696
2015-03-13 10:09:06,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62142 dest: /127.0.0.1:60686
2015-03-13 10:09:06,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194 src: /127.0.0.1:62143 dest: /127.0.0.1:60693
2015-03-13 10:09:06,345 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62143, dest: /127.0.0.1:60693, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 2162000
2015-03-13 10:09:06,345 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:06,346 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,346 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62142, dest: /127.0.0.1:60686, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 2698000
2015-03-13 10:09:06,346 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,347 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62141, dest: /127.0.0.1:60696, bytes: 90307, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-494706022_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, duration: 3966000
2015-03-13 10:09:06,348 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:06,348 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,349 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742018_1194{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:06,349 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-494706022_1
2015-03-13 10:09:06,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:06,361 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:06,361 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0016
2015-03-13 10:09:06,361 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from RUNNING to REMOVING
2015-03-13 10:09:06,361 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0016
2015-03-13 10:09:06,361 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from REMOVING to FINISHING
2015-03-13 10:09:07,180 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:07,205 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:07,206 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000002
2015-03-13 10:09:07,206 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:07,206 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:07,206 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000002
2015-03-13 10:09:07,207 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:07,207 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:07,207 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,207 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,207 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:07,207 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:07,369 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742006_1182 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:09:07,370 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742007_1183 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:09:07,370 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742008_1184 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:09:07,370 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742009_1185 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:09:07,370 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742013_1189 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:09:07,370 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742010_1186 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:09:07,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0016 dst=null perm=null
2015-03-13 10:09:07,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,410 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary
2015-03-13 10:09:07,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/_temporary dst=null perm=null
2015-03-13 10:09:07,418 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,419 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,423 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:09:07,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2015-03-13 10:09:07,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 179000
2015-03-13 10:09:07,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2015-03-13 10:09:07,428 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 174000
2015-03-13 10:09:07,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2015-03-13 10:09:07,430 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 140000
2015-03-13 10:09:07,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2015-03-13 10:09:07,432 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 148000
2015-03-13 10:09:07,439 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,440 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,444 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 4
2015-03-13 10:09:07,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2015-03-13 10:09:07,445 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 150000
2015-03-13 10:09:07,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2015-03-13 10:09:07,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 163000
2015-03-13 10:09:07,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2015-03-13 10:09:07,450 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 161000
2015-03-13 10:09:07,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2015-03-13 10:09:07,452 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 148000
2015-03-13 10:09:07,452 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/cross
2015-03-13 10:09:07,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross dst=null perm=null
2015-03-13 10:09:07,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2015-03-13 10:09:07,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00000 dst=null perm=null
2015-03-13 10:09:07,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 100, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191, duration: 160000
2015-03-13 10:09:07,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2015-03-13 10:09:07,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00001 dst=null perm=null
2015-03-13 10:09:07,459 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 60, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188, duration: 164000
2015-03-13 10:09:07,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2015-03-13 10:09:07,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00002 dst=null perm=null
2015-03-13 10:09:07,461 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62146, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190, duration: 165000
2015-03-13 10:09:07,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2015-03-13 10:09:07,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/cross/part-00003 dst=null perm=null
2015-03-13 10:09:07,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 76, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187, duration: 184000
2015-03-13 10:09:07,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:07,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:07,473 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,474 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:07,474 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:07,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:07,483 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join"]
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:09:07,484 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:09:07,485 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...fieldedpipesplatform/join
2015-03-13 10:09:07,491 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,499 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:07,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:07,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:07,503 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 17
2015-03-13 10:09:07,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=null
2015-03-13 10:09:07,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:07,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:09:07,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,509 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:07,510 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62149 dest: /127.0.0.1:60696
2015-03-13 10:09:07,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62150 dest: /127.0.0.1:60689
2015-03-13 10:09:07,513 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62151 dest: /127.0.0.1:60686
2015-03-13 10:09:07,517 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62151, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 1894000
2015-03-13 10:09:07,517 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,517 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,517 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62150, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 2283000
2015-03-13 10:09:07,518 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,518 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,518 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62149, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 3330000
2015-03-13 10:09:07,518 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,519 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742019_1195{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,520 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,521 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar
2015-03-13 10:09:07,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:07,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:07,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:07,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:09:07,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:09:07,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:09:07,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:09:07,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:09:07,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:07,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:07,528 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:07,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:07,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,532 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split
2015-03-13 10:09:07,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,534 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:07,535 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62152 dest: /127.0.0.1:60693
2015-03-13 10:09:07,536 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62153 dest: /127.0.0.1:60696
2015-03-13 10:09:07,537 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62154 dest: /127.0.0.1:60689
2015-03-13 10:09:07,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196 src: /127.0.0.1:62155 dest: /127.0.0.1:60686
2015-03-13 10:09:07,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62155, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 1679000
2015-03-13 10:09:07,541 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,541 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,541 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62154, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 2059000
2015-03-13 10:09:07,542 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,542 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,542 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62153, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 2806000
2015-03-13 10:09:07,542 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,543 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,543 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62152, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 3234000
2015-03-13 10:09:07,543 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,544 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742020_1196{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:07,545 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,548 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:07,549 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62156 dest: /127.0.0.1:60689
2015-03-13 10:09:07,551 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62157 dest: /127.0.0.1:60686
2015-03-13 10:09:07,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197 src: /127.0.0.1:62158 dest: /127.0.0.1:60696
2015-03-13 10:09:07,554 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62158, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 1007000
2015-03-13 10:09:07,554 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,554 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,554 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62157, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 1354000
2015-03-13 10:09:07,555 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,555 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,555 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62156, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 2094000
2015-03-13 10:09:07,555 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,556 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742021_1197{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,557 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,558 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:09:07,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:07,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:07,561 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:07,562 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:07,565 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:07,566 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62159 dest: /127.0.0.1:60686
2015-03-13 10:09:07,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62160 dest: /127.0.0.1:60689
2015-03-13 10:09:07,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198 src: /127.0.0.1:62161 dest: /127.0.0.1:60696
2015-03-13 10:09:07,571 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62161, dest: /127.0.0.1:60696, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 1636000
2015-03-13 10:09:07,571 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:07,572 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,572 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62160, dest: /127.0.0.1:60689, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 2164000
2015-03-13 10:09:07,572 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,572 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,573 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62159, dest: /127.0.0.1:60686, bytes: 97628, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 2955000
2015-03-13 10:09:07,573 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:07,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742022_1198{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:07,577 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:07,577 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0017
2015-03-13 10:09:07,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=null
2015-03-13 10:09:07,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:07,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:07,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,581 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:07,581 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:07,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:07,581 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:07,582 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:07,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:07,582 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:07,582 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:07,582 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:07,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:07,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:07,584 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:07,584 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:07,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:07,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:07,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:07,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:07,587 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 17 submitted by user soberoi
2015-03-13 10:09:07,587 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0017
2015-03-13 10:09:07,587 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0017
2015-03-13 10:09:07,587 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from NEW to NEW_SAVING
2015-03-13 10:09:07,587 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0017
2015-03-13 10:09:07,588 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:07,588 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,588 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:07,588 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0017 from user: soberoi activated in queue: default
2015-03-13 10:09:07,588 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0017 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:07,588 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0017 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:07,588 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0017 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:07,588 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0017_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:07,589 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:07,589 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:07,591 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0017/
2015-03-13 10:09:07,591 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0017
2015-03-13 10:09:07,591 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0017/
2015-03-13 10:09:07,632 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:07,632 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:07,632 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:07,633 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0017_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:07,633 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:07,633 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:07,634 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0017 AttemptId: appattempt_1426266260362_0017_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:09:07,634 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:07,634 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:07,635 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,635 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0017_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:09:07,638 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:07,639 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000001 by user soberoi
2015-03-13 10:09:07,639 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:07,639 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:07,639 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:07,639 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000001 to application application_1426266260362_0017
2015-03-13 10:09:07,639 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0017_000001
2015-03-13 10:09:07,640 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:07,640 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:07,640 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:07,640 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:07,640 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,640 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:07,641 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000001
2015-03-13 10:09:07,650 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0017_01_000001.tokens. Credentials list:
2015-03-13 10:09:07,665 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:07,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0017_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001.tokens
2015-03-13 10:09:07,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:07,783 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:07,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:07,797 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62165, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 482000
2015-03-13 10:09:07,815 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:07,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:07,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:07,838 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62145, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 166000
2015-03-13 10:09:07,850 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:07,883 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 185000
2015-03-13 10:09:07,895 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:07,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:07,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:07,927 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62147, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1240182633_8781, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 278000
2015-03-13 10:09:07,939 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:07,940 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:07,940 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:07,940 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:07,965 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:07,965 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:07,966 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:07,966 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:07,967 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:07,967 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:07,971 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:07,971 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:08,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001/default_container_executor.sh]
2015-03-13 10:09:08,145 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:08,146 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742012_1188
2015-03-13 10:09:08,146 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:08,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:08,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:08,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:08,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:08,345 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:08,346 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:08,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197
2015-03-13 10:09:08,519 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192
2015-03-13 10:09:08,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196
2015-03-13 10:09:08,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742014_1190
2015-03-13 10:09:08,520 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742015_1191
2015-03-13 10:09:08,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742018_1194
2015-03-13 10:09:08,521 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742011_1187
2015-03-13 10:09:08,522 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198
2015-03-13 10:09:08,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:08,634 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:08,725 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:08,726 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742017_1193
2015-03-13 10:09:08,726 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742013_1189
2015-03-13 10:09:09,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:09,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:09,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:09,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED dst=null perm=null
2015-03-13 10:09:09,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:09:09,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_FAIL dst=null perm=null
2015-03-13 10:09:09,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=null
2015-03-13 10:09:09,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:09:09,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:09:09,882 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742019_1195 to datanode(s) 127.0.0.1:60693
2015-03-13 10:09:09,882 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742009_1185, blk_1073742010_1186]
2015-03-13 10:09:09,882 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742009_1185, blk_1073742010_1186, blk_1073742013_1189]
2015-03-13 10:09:10,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:10,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:10,121 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62167, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742021_1197, duration: 129000
2015-03-13 10:09:10,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:10,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:10,496 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 to 127.0.0.1:60693
2015-03-13 10:09:10,496 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:10,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:10,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:10,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:10,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:10,497 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:10,498 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:10,498 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:10,498 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:10,498 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62170 dest: /127.0.0.1:60693
2015-03-13 10:09:10,498 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:09:10,500 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195 src: /127.0.0.1:62170 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:09:10,500 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742019_1195 size 254067
2015-03-13 10:09:10,641 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:10,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:10,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:10,907 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:10,908 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0017_000001
2015-03-13 10:09:10,908 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0017 APPATTEMPTID=appattempt_1426266260362_0017_000001
2015-03-13 10:09:10,908 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:10,908 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from ACCEPTED to RUNNING
2015-03-13 10:09:10,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:10,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:10,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:11,117 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:11,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62174 dest: /127.0.0.1:60686
2015-03-13 10:09:11,164 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62175 dest: /127.0.0.1:60689
2015-03-13 10:09:11,165 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199 src: /127.0.0.1:62176 dest: /127.0.0.1:60696
2015-03-13 10:09:11,172 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62176, dest: /127.0.0.1:60696, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 5207000
2015-03-13 10:09:11,172 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:11,172 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,172 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62175, dest: /127.0.0.1:60689, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 5707000
2015-03-13 10:09:11,173 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:11,173 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,173 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62174, dest: /127.0.0.1:60686, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 6642000
2015-03-13 10:09:11,173 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:11,174 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742023_1199{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:11,178 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:11,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:11,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,195 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,196 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:12,196 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:12,196 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0017_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,196 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:12,196 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,197 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,197 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:12,197 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:12,197 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0017_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,197 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:12,198 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,219 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,219 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:12,219 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:12,219 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,220 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:12,220 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,221 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:12,221 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:12,221 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,221 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:12,221 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,222 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:12,222 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:12,222 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:12,222 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0017 container=Container: [ContainerId: container_1426266260362_0017_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0017_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,223 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:12,223 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:12,504 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0016_01_000001 succeeded
2015-03-13 10:09:12,504 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:12,504 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0016_01_000001
2015-03-13 10:09:12,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0016_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:12,514 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0016_01_000001 from application application_1426266260362_0016
2015-03-13 10:09:12,514 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:12,515 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0016
2015-03-13 10:09:12,513 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,514 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0016/container_1426266260362_0016_01_000001
2015-03-13 10:09:12,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:12,788 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:12,882 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742009_1185, blk_1073742010_1186, blk_1073742013_1189]
2015-03-13 10:09:12,883 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742006_1182, blk_1073742007_1183, blk_1073742008_1184, blk_1073742013_1189]
2015-03-13 10:09:12,947 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,947 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,948 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:12,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:12,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195
2015-03-13 10:09:12,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:12,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:12,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:12,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:12,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:13,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:13,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:13,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:13,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:13,083 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:13,083 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:13,086 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000002 by user soberoi
2015-03-13 10:09:13,086 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:13,086 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:13,086 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:13,086 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000002 to application application_1426266260362_0017
2015-03-13 10:09:13,086 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000003 by user soberoi
2015-03-13 10:09:13,087 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:13,087 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:13,087 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,087 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000003 to application application_1426266260362_0017
2015-03-13 10:09:13,087 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,087 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,087 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,087 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,088 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,088 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,088 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000004 by user soberoi
2015-03-13 10:09:13,088 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0017
2015-03-13 10:09:13,088 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:13,088 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000005 by user soberoi
2015-03-13 10:09:13,089 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:13,088 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,089 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000002
2015-03-13 10:09:13,089 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from NEW to INITING
2015-03-13 10:09:13,089 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000004 to application application_1426266260362_0017
2015-03-13 10:09:13,089 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000005 to application application_1426266260362_0017
2015-03-13 10:09:13,090 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from INITING to RUNNING
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,090 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,090 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0017_01_000006 by user soberoi
2015-03-13 10:09:13,090 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,090 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,090 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,090 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,091 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:13,091 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,091 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,091 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,091 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0017_01_000006 to application application_1426266260362_0017
2015-03-13 10:09:13,091 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000005
2015-03-13 10:09:13,090 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,092 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000003
2015-03-13 10:09:13,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:13,093 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000004
2015-03-13 10:09:13,094 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:13,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0017
2015-03-13 10:09:13,094 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:13,095 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0017
2015-03-13 10:09:13,095 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0017_01_000006
2015-03-13 10:09:13,115 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0017_01_000002.tokens. Credentials list:
2015-03-13 10:09:13,115 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000006.tokens. Credentials list:
2015-03-13 10:09:13,116 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0017_01_000005.tokens. Credentials list:
2015-03-13 10:09:13,116 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0017_01_000003.tokens. Credentials list:
2015-03-13 10:09:13,116 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000004.tokens. Credentials list:
2015-03-13 10:09:13,136 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:13,137 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:13,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 16 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:13,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0016_01_000001
2015-03-13 10:09:13,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0016_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:13,202 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0016_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:13,202 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0016 CONTAINERID=container_1426266260362_0016_01_000001
2015-03-13 10:09:13,202 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0016_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:13,202 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:13,202 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0016_000001
2015-03-13 10:09:13,202 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0016_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:13,202 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0016_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:13,202 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:13,203 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:09:13,203 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0016_000001 released container container_1426266260362_0016_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:13,202 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0016 State change from FINISHING to FINISHED
2015-03-13 10:09:13,203 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0016_000001 is done. finalState=FINISHED
2015-03-13 10:09:13,203 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0016_000001
2015-03-13 10:09:13,203 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0016
2015-03-13 10:09:13,203 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0016 requests cleared
2015-03-13 10:09:13,203 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0016 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:13,203 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0016 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:13,203 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0016,name=[E7F6D5868D024899941007FA966EB2C9/DF3D800AAAC346239F59A15452AAF080] lhs*rhs/(1/1) ...ieldedpipesplatform/cross,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0016/jobhistory/job/job_1426266260362_0016,appMasterHost=Edinburgh.local,startTime=1426266532975,finishTime=1426266546361,finalStatus=SUCCEEDED
2015-03-13 10:09:13,206 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0016_000001 (auth:SIMPLE)
2015-03-13 10:09:13,207 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0016_01_000001
2015-03-13 10:09:13,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,220 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:13,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:13,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,220 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0016
2015-03-13 10:09:13,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:13,221 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:13,221 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0016, with delay of 10800 seconds
2015-03-13 10:09:13,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006.tokens
2015-03-13 10:09:13,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0017_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002.tokens
2015-03-13 10:09:13,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:13,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:13,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar dst=null perm=null
2015-03-13 10:09:13,316 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62184, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-231761080_8926, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 476000
2015-03-13 10:09:13,322 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62185, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_498224832_8929, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742019_1195, duration: 476000
2015-03-13 10:09:13,337 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,343 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,352 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:13,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml dst=null perm=null
2015-03-13 10:09:13,367 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62184, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-231761080_8926, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 257000
2015-03-13 10:09:13,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62185, bytes: 98392, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_498224832_8929, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742022_1198, duration: 263000
2015-03-13 10:09:13,382 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,382 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,383 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,383 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,393 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:13,394 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,394 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:13,427 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,427 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,436 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,436 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,437 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,437 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,444 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,444 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:13,444 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,444 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:13,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:13,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:13,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:13,501 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:13,502 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:13,502 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:13,502 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:13,503 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:13,570 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005/default_container_executor.sh]
2015-03-13 10:09:13,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004/default_container_executor.sh]
2015-03-13 10:09:13,575 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002/default_container_executor.sh]
2015-03-13 10:09:13,580 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003/default_container_executor.sh]
2015-03-13 10:09:13,596 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006/default_container_executor.sh]
2015-03-13 10:09:13,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:13,733 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199
2015-03-13 10:09:13,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006 for deletion
2015-03-13 10:09:13,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007 for deletion
2015-03-13 10:09:13,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008 for deletion
2015-03-13 10:09:13,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009 for deletion
2015-03-13 10:09:13,869 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742006_1182 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742006
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010 for deletion
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742007_1183 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742007
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013 for deletion
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742008_1184 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742008
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742009_1185 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742009
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742010_1186 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742010
2015-03-13 10:09:13,870 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742013_1189 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742013
2015-03-13 10:09:13,962 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:09:14,204 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,204 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,204 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:14,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0016
2015-03-13 10:09:14,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,205 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0016 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:14,205 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0016, with delay of 10800 seconds
2015-03-13 10:09:14,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0016
2015-03-13 10:09:14,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,222 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,411 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,532 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0017_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004.tokens
2015-03-13 10:09:14,533 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:14,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0017_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003.tokens
2015-03-13 10:09:14,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:14,647 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:14,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:14,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0017_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005.tokens
2015-03-13 10:09:14,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:15,209 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,209 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:15,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,215 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,215 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:16,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,235 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,235 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:17,662 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,225 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,237 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:18,663 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,240 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,240 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,241 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:19,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:20,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:21,235 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,235 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,250 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,250 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,251 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:21,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:21,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:21,449 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62196, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 144000
2015-03-13 10:09:21,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job.split dst=null perm=null
2015-03-13 10:09:21,539 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62200, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,572 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62201, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 158000
2015-03-13 10:09:21,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:21,596 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62203, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 198000
2015-03-13 10:09:21,612 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62202, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,618 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,629 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62204, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742020_1196, duration: 148000
2015-03-13 10:09:21,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:21,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:21,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:21,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,702 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62205, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 153000
2015-03-13 10:09:21,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:21,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62206, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:09:21,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:21,753 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62207, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 174000
2015-03-13 10:09:21,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:21,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62208, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:09:22,076 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:22,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,118 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62209 dest: /127.0.0.1:60696
2015-03-13 10:09:22,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62210 dest: /127.0.0.1:60693
2015-03-13 10:09:22,121 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200 src: /127.0.0.1:62211 dest: /127.0.0.1:60689
2015-03-13 10:09:22,123 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62212, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:09:22,130 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62211, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 6967000
2015-03-13 10:09:22,130 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,130 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,131 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62210, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 7830000
2015-03-13 10:09:22,131 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,131 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,131 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62209, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 8628000
2015-03-13 10:09:22,132 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,132 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742024_1200{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:22,133 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62200, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:09:22,137 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0017_m_000002_0_-1525715967_1
2015-03-13 10:09:22,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0 dst=null perm=null
2015-03-13 10:09:22,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0 dst=null perm=null
2015-03-13 10:09:22,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002 dst=null perm=null
2015-03-13 10:09:22,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,158 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,178 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000004
2015-03-13 10:09:22,178 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,178 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,178 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000004
2015-03-13 10:09:22,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,191 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000004 is : 143
2015-03-13 10:09:22,193 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,195 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62214 dest: /127.0.0.1:60696
2015-03-13 10:09:22,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62215 dest: /127.0.0.1:60686
2015-03-13 10:09:22,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202 src: /127.0.0.1:62216 dest: /127.0.0.1:60693
2015-03-13 10:09:22,202 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist for DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,203 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,205 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,205 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000004 from application application_1426266260362_0017
2015-03-13 10:09:22,205 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000004
2015-03-13 10:09:22,205 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62213 dest: /127.0.0.1:60696
2015-03-13 10:09:22,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62217 dest: /127.0.0.1:60689
2015-03-13 10:09:22,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201 src: /127.0.0.1:62218 dest: /127.0.0.1:60693
2015-03-13 10:09:22,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,234 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62201, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 196000
2015-03-13 10:09:22,235 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62218, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 8746000
2015-03-13 10:09:22,235 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,236 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62217, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 9341000
2015-03-13 10:09:22,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,236 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,236 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62213, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 10052000
2015-03-13 10:09:22,237 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,237 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742025_1201{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,258 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0017_m_000000_0_128292015_1
2015-03-13 10:09:22,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0 dst=null perm=null
2015-03-13 10:09:22,268 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0 dst=null perm=null
2015-03-13 10:09:22,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000 dst=null perm=null
2015-03-13 10:09:22,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,290 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000002
2015-03-13 10:09:22,290 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,291 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,291 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000002
2015-03-13 10:09:22,291 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,291 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,303 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000002 is : 143
2015-03-13 10:09:22,314 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,316 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,315 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000002
2015-03-13 10:09:22,316 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,316 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000002 from application application_1426266260362_0017
2015-03-13 10:09:22,317 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,317 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,317 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62219 dest: /127.0.0.1:60696
2015-03-13 10:09:22,319 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62220 dest: /127.0.0.1:60689
2015-03-13 10:09:22,320 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203 src: /127.0.0.1:62221 dest: /127.0.0.1:60693
2015-03-13 10:09:22,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,328 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62221, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 6110000
2015-03-13 10:09:22,328 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,328 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,328 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62220, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 6759000
2015-03-13 10:09:22,328 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,329 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,329 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62219, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 7451000
2015-03-13 10:09:22,329 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,329 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742027_1203{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,342 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0017_m_000001_0_810505873_1
2015-03-13 10:09:22,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62222, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 151000
2015-03-13 10:09:22,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0 dst=null perm=null
2015-03-13 10:09:22,356 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0 dst=null perm=null
2015-03-13 10:09:22,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001 dst=null perm=null
2015-03-13 10:09:22,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,368 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:22,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:22,372 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000003
2015-03-13 10:09:22,372 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000002
2015-03-13 10:09:22,373 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,373 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000003
2015-03-13 10:09:22,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,374 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:22,374 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:22,374 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000002
2015-03-13 10:09:22,374 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:22,374 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:09:22,374 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,374 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,374 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:09:22,375 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:22,386 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000003 is : 143
2015-03-13 10:09:22,392 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62204, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 140000
2015-03-13 10:09:22,398 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000003
2015-03-13 10:09:22,399 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:22,400 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,400 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000003 from application application_1426266260362_0017
2015-03-13 10:09:22,400 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,401 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,408 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0017_m_000004_0_-413749313_1
2015-03-13 10:09:22,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62223 dest: /127.0.0.1:60689
2015-03-13 10:09:22,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0 dst=null perm=null
2015-03-13 10:09:22,421 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62224 dest: /127.0.0.1:60696
2015-03-13 10:09:22,422 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204 src: /127.0.0.1:62225 dest: /127.0.0.1:60686
2015-03-13 10:09:22,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0 dst=null perm=null
2015-03-13 10:09:22,432 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62225, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 8762000
2015-03-13 10:09:22,433 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,433 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,433 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62224, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 9433000
2015-03-13 10:09:22,433 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,434 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,434 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62223, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 10186000
2015-03-13 10:09:22,434 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,434 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742028_1204{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:22,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004 dst=null perm=null
2015-03-13 10:09:22,438 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0017_m_000003_0_1381020241_1
2015-03-13 10:09:22,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0 dst=null perm=null
2015-03-13 10:09:22,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0 dst=null perm=null
2015-03-13 10:09:22,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003 dst=null perm=null
2015-03-13 10:09:22,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/_temporary/attempt_1426266260362_0017_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:22,464 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000006
2015-03-13 10:09:22,464 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:22,464 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,464 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:22,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000004
2015-03-13 10:09:22,465 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000006
2015-03-13 10:09:22,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,465 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:22,465 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:22,465 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000004
2015-03-13 10:09:22,466 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:22,466 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:22,466 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,466 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:22,466 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:22,466 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:22,471 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000005
2015-03-13 10:09:22,471 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:22,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:22,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,477 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,478 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000006 is : 143
2015-03-13 10:09:22,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1 dst=null perm=null
2015-03-13 10:09:22,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,490 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:22,490 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,491 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000005
2015-03-13 10:09:22,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000 dst=null perm=null
2015-03-13 10:09:22,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2015-03-13 10:09:22,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001 dst=null perm=null
2015-03-13 10:09:22,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2015-03-13 10:09:22,505 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0017_01_000005 is : 143
2015-03-13 10:09:22,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002 dst=null perm=null
2015-03-13 10:09:22,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2015-03-13 10:09:22,512 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003 dst=null perm=null
2015-03-13 10:09:22,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2015-03-13 10:09:22,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:22,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000006
2015-03-13 10:09:22,518 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:22,519 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,520 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000006 from application application_1426266260362_0017
2015-03-13 10:09:22,520 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,520 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,520 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:22,520 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:22,520 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000005 from application application_1426266260362_0017
2015-03-13 10:09:22,520 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:22,520 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:22,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000005
2015-03-13 10:09:22,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:22,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004 dst=null perm=null
2015-03-13 10:09:22,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2015-03-13 10:09:22,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary/1/task_1426266260362_0017_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary dst=null perm=null
2015-03-13 10:09:22,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,535 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,539 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,551 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62216, dest: /127.0.0.1:60693, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 352276000
2015-03-13 10:09:22,552 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,553 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,553 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62215, dest: /127.0.0.1:60686, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 353487000
2015-03-13 10:09:22,553 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,554 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,555 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62214, dest: /127.0.0.1:60696, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 355375000
2015-03-13 10:09:22,555 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,556 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742026_1202{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,557 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,565 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:22,567 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62226 dest: /127.0.0.1:60693
2015-03-13 10:09:22,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62227 dest: /127.0.0.1:60689
2015-03-13 10:09:22,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205 src: /127.0.0.1:62228 dest: /127.0.0.1:60696
2015-03-13 10:09:22,573 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62228, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 1523000
2015-03-13 10:09:22,573 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,573 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,573 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62227, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 2175000
2015-03-13 10:09:22,574 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,574 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,574 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62226, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 2943000
2015-03-13 10:09:22,574 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,575 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742029_1205{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,576 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist dst=null perm=null
2015-03-13 10:09:22,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:22,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist dst=null perm=null
2015-03-13 10:09:22,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:22,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1.jhist dst=null perm=null
2015-03-13 10:09:22,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,602 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62229, bytes: 53714, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202, duration: 208000
2015-03-13 10:09:22,604 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:22,606 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62230 dest: /127.0.0.1:60693
2015-03-13 10:09:22,607 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62231 dest: /127.0.0.1:60689
2015-03-13 10:09:22,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206 src: /127.0.0.1:62232 dest: /127.0.0.1:60696
2015-03-13 10:09:22,612 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62232, dest: /127.0.0.1:60696, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 1669000
2015-03-13 10:09:22,612 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,613 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,613 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62231, dest: /127.0.0.1:60689, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 2493000
2015-03-13 10:09:22,613 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,614 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62230, dest: /127.0.0.1:60693, bytes: 53294, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, duration: 3462000
2015-03-13 10:09:22,614 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,615 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742030_1206{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:22,617 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml dst=null perm=null
2015-03-13 10:09:22,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:22,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml dst=null perm=null
2015-03-13 10:09:22,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:22,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017/job_1426266260362_0017_1_conf.xml dst=null perm=null
2015-03-13 10:09:22,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:22,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62229, bytes: 91152, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742023_1199, duration: 265000
2015-03-13 10:09:22,630 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:22,631 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62233 dest: /127.0.0.1:60696
2015-03-13 10:09:22,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62234 dest: /127.0.0.1:60689
2015-03-13 10:09:22,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207 src: /127.0.0.1:62235 dest: /127.0.0.1:60693
2015-03-13 10:09:22,636 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62235, dest: /127.0.0.1:60693, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 1831000
2015-03-13 10:09:22,637 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:22,637 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,637 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62234, dest: /127.0.0.1:60689, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 2450000
2015-03-13 10:09:22,637 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,638 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,638 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62233, dest: /127.0.0.1:60696, bytes: 90444, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1266609083_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, duration: 3353000
2015-03-13 10:09:22,638 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:22,639 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742031_1207{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:22,641 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1266609083_1
2015-03-13 10:09:22,642 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:22,653 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:22,653 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0017
2015-03-13 10:09:22,653 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from RUNNING to REMOVING
2015-03-13 10:09:22,653 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0017
2015-03-13 10:09:22,654 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from REMOVING to FINISHING
2015-03-13 10:09:22,676 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:22,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:22,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:22,799 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:22,800 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:22,800 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:22,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:22,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:22,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:22,985 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:22,985 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:22,986 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:22,987 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:22,987 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:22,987 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:23,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:23,357 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:23,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000003
2015-03-13 10:09:23,378 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,379 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,379 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000003
2015-03-13 10:09:23,379 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:23,379 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:23,379 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,379 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,380 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:23,380 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000003 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:23,475 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,476 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000005
2015-03-13 10:09:23,476 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:23,476 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000006
2015-03-13 10:09:23,477 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,477 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,477 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000005
2015-03-13 10:09:23,477 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:23,477 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:23,477 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,478 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,478 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:23,478 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:23,478 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:23,478 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:09:23,478 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000006
2015-03-13 10:09:23,479 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:23,479 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:23,479 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,479 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:23,479 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:23,479 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:23,659 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742019_1195 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:09:23,660 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742020_1196 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:09:23,660 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742021_1197 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:09:23,660 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742022_1198 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:09:23,660 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742026_1202 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:09:23,660 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742023_1199 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:09:23,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0017 dst=null perm=null
2015-03-13 10:09:23,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:23,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,691 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary
2015-03-13 10:09:23,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/_temporary dst=null perm=null
2015-03-13 10:09:23,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,699 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,703 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:09:23,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2015-03-13 10:09:23,705 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 185000
2015-03-13 10:09:23,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2015-03-13 10:09:23,708 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 156000
2015-03-13 10:09:23,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2015-03-13 10:09:23,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62239, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 156000
2015-03-13 10:09:23,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2015-03-13 10:09:23,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 150000
2015-03-13 10:09:23,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2015-03-13 10:09:23,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,720 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,721 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,724 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:09:23,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2015-03-13 10:09:23,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 171000
2015-03-13 10:09:23,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2015-03-13 10:09:23,728 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 156000
2015-03-13 10:09:23,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2015-03-13 10:09:23,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 129000
2015-03-13 10:09:23,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2015-03-13 10:09:23,731 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 158000
2015-03-13 10:09:23,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2015-03-13 10:09:23,732 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/join
2015-03-13 10:09:23,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join dst=null perm=null
2015-03-13 10:09:23,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2015-03-13 10:09:23,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00000 dst=null perm=null
2015-03-13 10:09:23,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62239, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201, duration: 145000
2015-03-13 10:09:23,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2015-03-13 10:09:23,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00001 dst=null perm=null
2015-03-13 10:09:23,738 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742031_1207
2015-03-13 10:09:23,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203, duration: 109000
2015-03-13 10:09:23,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742025_1201
2015-03-13 10:09:23,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742027_1203
2015-03-13 10:09:23,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2015-03-13 10:09:23,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742030_1206
2015-03-13 10:09:23,740 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205
2015-03-13 10:09:23,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00002 dst=null perm=null
2015-03-13 10:09:23,740 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200
2015-03-13 10:09:23,740 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742026_1202
2015-03-13 10:09:23,740 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204
2015-03-13 10:09:23,741 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742024_1200, duration: 141000
2015-03-13 10:09:23,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2015-03-13 10:09:23,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00003 dst=null perm=null
2015-03-13 10:09:23,743 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62237, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742028_1204, duration: 165000
2015-03-13 10:09:23,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2015-03-13 10:09:23,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/join/part-00004 dst=null perm=null
2015-03-13 10:09:23,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:23,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:23,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:23,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:23,757 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,758 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:23,759 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:23,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:23,774 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] starting
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby"]
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] parallel execution is enabled: true
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] starting jobs: 1
2015-03-13 10:09:23,775 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [merging] allocating threads: 1
2015-03-13 10:09:23,776 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] starting step: (1/1) ...platform/joinsintogroupby
2015-03-13 10:09:23,784 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,793 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:23,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:23,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:23,797 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 18
2015-03-13 10:09:23,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=null
2015-03-13 10:09:23,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:23,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:09:23,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:23,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,803 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:23,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62241 dest: /127.0.0.1:60696
2015-03-13 10:09:23,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62242 dest: /127.0.0.1:60693
2015-03-13 10:09:23,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62243 dest: /127.0.0.1:60689
2015-03-13 10:09:23,810 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62243, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 1720000
2015-03-13 10:09:23,810 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,811 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,811 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62242, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 2327000
2015-03-13 10:09:23,811 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,811 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,811 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62241, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 2973000
2015-03-13 10:09:23,812 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,813 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742032_1208{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:23,813 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,814 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar
2015-03-13 10:09:23,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:23,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:23,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:23,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:23,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:09:23,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:09:23,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:09:23,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:09:23,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:09:23,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:23,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:23,822 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:23,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:23,824 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:23,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:23,825 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,826 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:23,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:23,827 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:23,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:23,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,831 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split
2015-03-13 10:09:23,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:23,832 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:09:23,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62244 dest: /127.0.0.1:60686
2015-03-13 10:09:23,834 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62245 dest: /127.0.0.1:60689
2015-03-13 10:09:23,835 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62246 dest: /127.0.0.1:60696
2015-03-13 10:09:23,836 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209 src: /127.0.0.1:62247 dest: /127.0.0.1:60693
2015-03-13 10:09:23,839 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62247, dest: /127.0.0.1:60693, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 1692000
2015-03-13 10:09:23,839 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,840 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,840 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62246, dest: /127.0.0.1:60696, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 2001000
2015-03-13 10:09:23,840 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,840 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,840 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62245, dest: /127.0.0.1:60689, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 2763000
2015-03-13 10:09:23,841 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,841 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,841 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62244, dest: /127.0.0.1:60686, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 3351000
2015-03-13 10:09:23,841 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,842 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742033_1209{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:09:23,843 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,846 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:23,848 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62248 dest: /127.0.0.1:60696
2015-03-13 10:09:23,849 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62249 dest: /127.0.0.1:60689
2015-03-13 10:09:23,850 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210 src: /127.0.0.1:62250 dest: /127.0.0.1:60686
2015-03-13 10:09:23,852 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62250, dest: /127.0.0.1:60686, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 1153000
2015-03-13 10:09:23,852 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,853 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,853 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62249, dest: /127.0.0.1:60689, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 1656000
2015-03-13 10:09:23,853 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,854 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62248, dest: /127.0.0.1:60696, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 2361000
2015-03-13 10:09:23,854 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,854 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,855 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742034_1210{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,855 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,856 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:6
2015-03-13 10:09:23,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:23,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:23,859 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:23,860 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:23,862 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:23,864 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62251 dest: /127.0.0.1:60696
2015-03-13 10:09:23,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62252 dest: /127.0.0.1:60693
2015-03-13 10:09:23,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211 src: /127.0.0.1:62253 dest: /127.0.0.1:60686
2015-03-13 10:09:23,868 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62253, dest: /127.0.0.1:60686, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 1491000
2015-03-13 10:09:23,869 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:23,869 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,869 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62252, dest: /127.0.0.1:60693, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 2000000
2015-03-13 10:09:23,869 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,870 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,870 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62251, dest: /127.0.0.1:60696, bytes: 100334, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 2710000
2015-03-13 10:09:23,870 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:23,871 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742035_1211{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:23,871 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:23,872 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0018
2015-03-13 10:09:23,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=null
2015-03-13 10:09:23,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:23,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:23,874 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:23,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:23,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:23,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:23,876 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:23,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:23,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:23,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:23,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:23,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:23,880 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:23,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:23,882 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 18 submitted by user soberoi
2015-03-13 10:09:23,882 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0018
2015-03-13 10:09:23,882 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0018
2015-03-13 10:09:23,882 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0018
2015-03-13 10:09:23,882 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from NEW to NEW_SAVING
2015-03-13 10:09:23,882 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:23,883 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0018_000001
2015-03-13 10:09:23,883 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:23,883 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0018 from user: soberoi activated in queue: default
2015-03-13 10:09:23,883 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0018 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:23,883 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0018 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:23,883 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0018 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:23,883 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0018_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:23,883 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:23,885 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:23,885 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0018/
2015-03-13 10:09:23,886 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] submitted hadoop job: job_1426266260362_0018
2015-03-13 10:09:23,886 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [merging] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0018/
2015-03-13 10:09:24,382 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:24,383 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:24,383 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:24,383 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0018_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:24,384 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:24,384 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:24,384 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:24,385 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0018 AttemptId: appattempt_1426266260362_0018_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:09:24,385 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:24,385 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,385 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:24,385 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0018_000001
2015-03-13 10:09:24,386 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,386 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0018_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:09:24,388 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:24,389 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000001 by user soberoi
2015-03-13 10:09:24,389 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:24,389 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:24,390 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:24,390 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000001 to application application_1426266260362_0018
2015-03-13 10:09:24,390 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0018_000001
2015-03-13 10:09:24,390 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:24,390 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:24,390 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:24,390 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:24,390 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,390 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:24,391 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000001
2015-03-13 10:09:24,400 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0018_01_000001.tokens. Credentials list:
2015-03-13 10:09:24,414 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:24,480 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0018_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001.tokens
2015-03-13 10:09:24,481 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:24,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:24,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:24,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:24,543 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 506000
2015-03-13 10:09:24,563 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:24,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:24,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:24,586 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62257, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 115000
2015-03-13 10:09:24,598 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:24,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:24,616 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:24,621 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62257, bytes: 2153, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 166000
2015-03-13 10:09:24,633 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:24,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:24,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:24,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62238, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1745663571_9329, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 254000
2015-03-13 10:09:24,669 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:24,669 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:24,680 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:24,692 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:24,692 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:24,756 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001/default_container_executor.sh]
2015-03-13 10:09:24,891 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742032_1208 to datanode(s) 127.0.0.1:60686
2015-03-13 10:09:24,891 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199, blk_1073742026_1202]
2015-03-13 10:09:24,891 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199]
2015-03-13 10:09:25,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:25,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:25,508 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:25,508 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:25,509 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:25,510 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:25,511 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:25,511 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:25,511 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:25,685 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:25,876 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 to 127.0.0.1:60686
2015-03-13 10:09:25,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62258 dest: /127.0.0.1:60686
2015-03-13 10:09:25,878 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:09:25,879 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208 src: /127.0.0.1:62258 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:09:25,880 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742032_1208 size 254067
2015-03-13 10:09:26,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:26,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED dst=null perm=null
2015-03-13 10:09:26,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:09:26,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_FAIL dst=null perm=null
2015-03-13 10:09:26,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:26,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=null
2015-03-13 10:09:26,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:09:26,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:09:26,687 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:26,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:26,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:26,764 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62260, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210, duration: 177000
2015-03-13 10:09:27,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:27,552 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:27,554 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0018_000001
2015-03-13 10:09:27,554 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0018 APPATTEMPTID=appattempt_1426266260362_0018_000001
2015-03-13 10:09:27,554 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:27,554 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from ACCEPTED to RUNNING
2015-03-13 10:09:27,575 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 1763 Total time for transactions(ms): 84 Number of transactions batched in Syncs: 2 Number of syncs: 1000 SyncTimes(ms): 288 219
2015-03-13 10:09:27,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:27,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:27,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:27,693 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:27,758 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:27,802 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62266 dest: /127.0.0.1:60696
2015-03-13 10:09:27,804 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:27,805 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:27,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62267 dest: /127.0.0.1:60693
2015-03-13 10:09:27,806 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:27,807 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212 src: /127.0.0.1:62268 dest: /127.0.0.1:60686
2015-03-13 10:09:27,815 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62268, dest: /127.0.0.1:60686, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 6648000
2015-03-13 10:09:27,816 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:27,816 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,816 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62267, dest: /127.0.0.1:60693, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 7137000
2015-03-13 10:09:27,816 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:27,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,817 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62266, dest: /127.0.0.1:60696, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 8037000
2015-03-13 10:09:27,817 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:27,817 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742036_1212{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:27,822 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:27,896 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742026_1202]
2015-03-13 10:09:27,896 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742019_1195, blk_1073742020_1196, blk_1073742021_1197, blk_1073742022_1198, blk_1073742023_1199, blk_1073742026_1202]
2015-03-13 10:09:27,992 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:27,993 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:28,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,197 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:28,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:28,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,362 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:28,387 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:28,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,601 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,601 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:28,601 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:28,602 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,602 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:28,602 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,603 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,603 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:28,603 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:28,603 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,603 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:28,604 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,604 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,604 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:28,604 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:28,605 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,605 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:28,605 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,605 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,605 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:28,605 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:09:28,605 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,606 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:28,606 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,687 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:28,687 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:28,687 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:28,687 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:28,687 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:28,688 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:28,698 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:28,699 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,699 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:28,699 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:28,699 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0018_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,699 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:28,700 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,700 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:28,700 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:28,700 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:28,700 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0018_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,701 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:09:28,701 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:28,749 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211
2015-03-13 10:09:28,795 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0017_01_000001 succeeded
2015-03-13 10:09:28,795 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:28,795 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0017/container_1426266260362_0017_01_000001
2015-03-13 10:09:28,803 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:28,804 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0017_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:28,804 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0017_01_000001 from application application_1426266260362_0017
2015-03-13 10:09:28,804 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:28,804 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0017
2015-03-13 10:09:28,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019 for deletion
2015-03-13 10:09:28,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020 for deletion
2015-03-13 10:09:28,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021 for deletion
2015-03-13 10:09:28,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022 for deletion
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742019_1195 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742019
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742020_1196 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742020
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023 for deletion
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026 for deletion
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742022_1198 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742022
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742021_1197 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742021
2015-03-13 10:09:28,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742023_1199 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742023
2015-03-13 10:09:28,883 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742026_1202 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742026
2015-03-13 10:09:28,955 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208
2015-03-13 10:09:28,956 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212
2015-03-13 10:09:28,956 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742034_1210
2015-03-13 10:09:28,957 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209
2015-03-13 10:09:29,387 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:29,584 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,585 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:29,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:29,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:29,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:29,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:29,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:29,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:29,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 17 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:29,701 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0017_01_000001
2015-03-13 10:09:29,701 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0017_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:29,701 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0017_000001
2015-03-13 10:09:29,701 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0017_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:29,702 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0017 CONTAINERID=container_1426266260362_0017_01_000001
2015-03-13 10:09:29,702 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0017_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:29,702 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0017_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:29,702 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0017 State change from FINISHING to FINISHED
2015-03-13 10:09:29,702 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:7> numContainers=7 user=soberoi user-resources=<memory:8192, vCores:7>
2015-03-13 10:09:29,702 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0017_000001
2015-03-13 10:09:29,702 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0017_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:29,702 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0017
2015-03-13 10:09:29,702 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0017,name=[E8F7ECEBD6AF435181C0FE297F64D1A5/DF54CDC6A1544804917CE472FDCAAAEE] lower*upper/(1/1) ...fieldedpipesplatform/join,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0017/jobhistory/job/job_1426266260362_0017,appMasterHost=Edinburgh.local,startTime=1426266547587,finishTime=1426266562654,finalStatus=SUCCEEDED
2015-03-13 10:09:29,702 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:29,703 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7
2015-03-13 10:09:29,703 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0017_000001 released container container_1426266260362_0017_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:29,703 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0017_000001 is done. finalState=FINISHED
2015-03-13 10:09:29,703 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0017 requests cleared
2015-03-13 10:09:29,703 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0017 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:29,703 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0017 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:29,705 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0017_000001 (auth:SIMPLE)
2015-03-13 10:09:29,706 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0017_01_000001
2015-03-13 10:09:29,713 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:29,713 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:29,716 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000002 by user soberoi
2015-03-13 10:09:29,716 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000003 by user soberoi
2015-03-13 10:09:29,717 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000007 by user soberoi
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0018
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000004 by user soberoi
2015-03-13 10:09:29,717 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:29,717 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:29,718 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from NEW to INITING
2015-03-13 10:09:29,718 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000007 to application application_1426266260362_0018
2015-03-13 10:09:29,718 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000006 by user soberoi
2015-03-13 10:09:29,718 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,718 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:29,717 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:29,718 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,719 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,719 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,719 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,719 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,719 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000006 to application application_1426266260362_0018
2015-03-13 10:09:29,719 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000007
2015-03-13 10:09:29,718 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000002 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000003 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000004 to application application_1426266260362_0018
2015-03-13 10:09:29,720 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,720 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,720 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,721 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,721 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,721 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000006
2015-03-13 10:09:29,717 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:29,717 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000005 by user soberoi
2015-03-13 10:09:29,722 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:29,720 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from INITING to RUNNING
2015-03-13 10:09:29,722 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,723 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000005 to application application_1426266260362_0018
2015-03-13 10:09:29,723 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,723 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,723 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,723 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,723 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,723 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,724 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,724 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,724 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,725 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:29,725 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000003
2015-03-13 10:09:29,726 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000002
2015-03-13 10:09:29,727 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000004
2015-03-13 10:09:29,728 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,728 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:29,729 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:29,729 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:29,729 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0018_01_000005
2015-03-13 10:09:29,748 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0018_01_000007.tokens. Credentials list:
2015-03-13 10:09:29,749 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000004.tokens. Credentials list:
2015-03-13 10:09:29,750 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000003.tokens. Credentials list:
2015-03-13 10:09:29,750 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0018_01_000006.tokens. Credentials list:
2015-03-13 10:09:29,752 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000002.tokens. Credentials list:
2015-03-13 10:09:29,754 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000005.tokens. Credentials list:
2015-03-13 10:09:29,772 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:29,772 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:29,858 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0018_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007.tokens
2015-03-13 10:09:29,858 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:29,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004.tokens
2015-03-13 10:09:29,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:29,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar dst=null perm=null
2015-03-13 10:09:29,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62276, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1347572288_9478, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 487000
2015-03-13 10:09:29,949 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62277, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_605198009_9479, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742032_1208, duration: 544000
2015-03-13 10:09:29,972 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:29,972 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:29,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml dst=null perm=null
2015-03-13 10:09:29,999 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62278, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_605198009_9479, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 290000
2015-03-13 10:09:30,004 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62277, bytes: 101118, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1347572288_9478, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742035_1211, duration: 265000
2015-03-13 10:09:30,015 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:30,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,015 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,024 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:30,024 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,024 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:30,063 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,063 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,071 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,071 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,076 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,077 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,079 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,079 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,085 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,085 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,102 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:30,102 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:30,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003/default_container_executor.sh]
2015-03-13 10:09:30,233 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005/default_container_executor.sh]
2015-03-13 10:09:30,240 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002/default_container_executor.sh]
2015-03-13 10:09:30,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007/default_container_executor.sh]
2015-03-13 10:09:30,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006/default_container_executor.sh]
2015-03-13 10:09:30,306 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004/default_container_executor.sh]
2015-03-13 10:09:30,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,390 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,390 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,391 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,391 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,391 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,391 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,391 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,496 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,497 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,497 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,497 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,497 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,498 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,498 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,602 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:09:30,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,607 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,608 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,706 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,706 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:30,706 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:30,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,707 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0017
2015-03-13 10:09:30,707 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0017 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:30,707 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0017, with delay of 10800 seconds
2015-03-13 10:09:30,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:30,706 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:30,707 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0017
2015-03-13 10:09:31,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,061 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,157 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005.tokens
2015-03-13 10:09:31,157 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0018_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006.tokens
2015-03-13 10:09:31,181 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,265 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,394 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002.tokens
2015-03-13 10:09:31,406 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:31,611 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,661 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0018_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003.tokens
2015-03-13 10:09:31,661 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:31,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:31,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,398 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,618 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,711 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:32,711 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,620 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,620 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,621 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,621 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,713 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:33,714 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,402 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,626 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,627 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:34,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,403 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,627 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,628 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:35,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,406 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,729 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:36,730 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,734 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:37,734 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,410 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,644 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,736 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:38,737 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,411 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:39,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:39,741 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,741 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:39,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:39,828 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:39,838 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62291, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 145000
2015-03-13 10:09:39,982 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62294, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 153000
2015-03-13 10:09:39,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:40,018 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62295, bytes: 1637, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 157000
2015-03-13 10:09:40,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job.split dst=null perm=null
2015-03-13 10:09:40,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:40,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62299, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 174000
2015-03-13 10:09:40,068 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62297, bytes: 605, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 1536, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 128000
2015-03-13 10:09:40,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:09:40,174 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62300, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 184000
2015-03-13 10:09:40,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:40,210 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62301, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742033_1209, duration: 119000
2015-03-13 10:09:40,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:40,222 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62302, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 166000
2015-03-13 10:09:40,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:40,338 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62303, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:09:40,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:40,372 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62304, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 173000
2015-03-13 10:09:40,415 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,651 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,744 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,748 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62305, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000001_0_107862477_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 183000
2015-03-13 10:09:40,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000001_0 dst=null perm=null
2015-03-13 10:09:40,819 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:40,821 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000003
2015-03-13 10:09:40,821 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,821 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,822 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000003
2015-03-13 10:09:40,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,834 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000003 is : 143
2015-03-13 10:09:40,838 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:40,840 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62308 dest: /127.0.0.1:60689
2015-03-13 10:09:40,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62309 dest: /127.0.0.1:60686
2015-03-13 10:09:40,842 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213 src: /127.0.0.1:62310 dest: /127.0.0.1:60696
2015-03-13 10:09:40,846 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist for DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:40,847 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000003
2015-03-13 10:09:40,847 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000003 from application application_1426266260362_0018
2015-03-13 10:09:40,848 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,848 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:40,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:09:40,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62294, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 141000
2015-03-13 10:09:40,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62311, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000000_0_-1276300845_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 160000
2015-03-13 10:09:40,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,884 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62312, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 189000
2015-03-13 10:09:40,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62312, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000002_0_-173108709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:09:40,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000000_0 dst=null perm=null
2015-03-13 10:09:40,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,918 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000002
2015-03-13 10:09:40,918 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:40,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000003
2015-03-13 10:09:40,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,919 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,919 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:40,920 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:09:40,920 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000003
2015-03-13 10:09:40,920 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:09:40,920 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:40,920 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,920 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,920 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:09:40,920 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:09:40,931 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000002 is : 143
2015-03-13 10:09:40,943 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,943 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,943 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,944 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,945 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000002 from application application_1426266260362_0018
2015-03-13 10:09:40,945 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,945 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:40,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000002_0 dst=null perm=null
2015-03-13 10:09:40,957 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000004
2015-03-13 10:09:40,957 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:40,957 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:09:40,957 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:40,958 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000002
2015-03-13 10:09:40,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:40,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:40,959 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000004
2015-03-13 10:09:40,959 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:40,959 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:09:40,959 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000002
2015-03-13 10:09:40,960 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:40,960 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:09:40,960 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,960 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:40,960 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:09:40,960 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:40,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:40,972 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62313, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000005_0_68992022_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 141000
2015-03-13 10:09:40,975 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000004 is : 143
2015-03-13 10:09:40,989 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:40,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:40,990 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:40,991 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000004 from application application_1426266260362_0018
2015-03-13 10:09:40,991 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:40,991 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000005_0 dst=null perm=null
2015-03-13 10:09:41,014 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:41,015 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,016 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000007
2015-03-13 10:09:41,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:41,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,022 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,028 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000007 is : 143
2015-03-13 10:09:41,060 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,060 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,061 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000007 from application application_1426266260362_0018
2015-03-13 10:09:41,061 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,061 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,061 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,061 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000007
2015-03-13 10:09:41,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,075 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62315, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000003_0_-20792857_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:09:41,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:41,106 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62316, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0018_m_000004_0_1920819369_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 143000
2015-03-13 10:09:41,110 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000003_0 dst=null perm=null
2015-03-13 10:09:41,119 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000005
2015-03-13 10:09:41,119 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:41,119 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:41,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000004
2015-03-13 10:09:41,120 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000005
2015-03-13 10:09:41,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:41,120 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:09:41,121 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000004
2015-03-13 10:09:41,121 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:41,121 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:09:41,121 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,121 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,121 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:09:41,121 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000004 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:41,130 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000005 is : 143
2015-03-13 10:09:41,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_m_000004_0 dst=null perm=null
2015-03-13 10:09:41,139 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,139 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:41,140 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,140 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000005 from application application_1426266260362_0018
2015-03-13 10:09:41,141 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,141 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,143 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:09:41,143 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000006
2015-03-13 10:09:41,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:41,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:41,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000007
2015-03-13 10:09:41,144 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:41,144 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:09:41,144 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000007
2015-03-13 10:09:41,144 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:09:41,144 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:09:41,145 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000007, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,145 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:41,145 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:09:41,145 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000007 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:09:41,152 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000006 is : 143
2015-03-13 10:09:41,159 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:41,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000006
2015-03-13 10:09:41,161 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:41,162 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:41,163 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000006 from application application_1426266260362_0018
2015-03-13 10:09:41,163 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:41,163 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:41,421 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:42,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:42,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000005
2015-03-13 10:09:42,123 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:42,123 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:09:42,123 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000005
2015-03-13 10:09:42,123 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:42,123 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:09:42,124 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,124 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,124 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:42,124 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:42,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:42,147 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000006
2015-03-13 10:09:42,148 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:42,148 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:09:42,148 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000006
2015-03-13 10:09:42,148 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:42,148 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:42,149 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,150 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:42,150 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:42,150 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:42,426 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:43,127 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:43,127 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:43,127 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:43,128 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0018 container=Container: [ContainerId: container_1426266260362_0018_01_000008, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0018_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:43,128 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:09:43,128 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:43,428 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:43,675 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:43,682 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0018_01_000008 by user soberoi
2015-03-13 10:09:43,683 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:43,683 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0018_01_000008 to application application_1426266260362_0018
2015-03-13 10:09:43,683 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:09:43,683 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0018
2015-03-13 10:09:43,683 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0018
2015-03-13 10:09:43,683 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:43,683 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0018
2015-03-13 10:09:43,684 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:43,708 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:43,708 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:43,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008/default_container_executor.sh]
2015-03-13 10:09:44,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:44,131 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:44,434 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:44,680 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:09:45,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:45,438 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:46,133 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:46,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,189 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:46,248 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62323 dest: /127.0.0.1:60693
2015-03-13 10:09:46,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62324 dest: /127.0.0.1:60696
2015-03-13 10:09:46,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214 src: /127.0.0.1:62325 dest: /127.0.0.1:60686
2015-03-13 10:09:46,261 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62325, dest: /127.0.0.1:60686, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 9424000
2015-03-13 10:09:46,261 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,262 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,262 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62324, dest: /127.0.0.1:60696, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 10075000
2015-03-13 10:09:46,262 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,262 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,263 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62323, dest: /127.0.0.1:60693, bytes: 336, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 10942000
2015-03-13 10:09:46,263 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,263 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742038_1214{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,266 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0018_r_000000_0_-1317155055_1
2015-03-13 10:09:46,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0 dst=null perm=null
2015-03-13 10:09:46,280 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0 dst=null perm=null
2015-03-13 10:09:46,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000 dst=null perm=null
2015-03-13 10:09:46,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/_temporary/attempt_1426266260362_0018_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:46,291 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:09:46,291 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000008
2015-03-13 10:09:46,291 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:09:46,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,298 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,301 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0018_01_000008 is : 143
2015-03-13 10:09:46,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1 dst=null perm=null
2015-03-13 10:09:46,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:46,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:46,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000 dst=null perm=null
2015-03-13 10:09:46,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2015-03-13 10:09:46,310 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:09:46,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:09:46,311 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000008 from application application_1426266260362_0018
2015-03-13 10:09:46,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000008
2015-03-13 10:09:46,311 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:46,312 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:46,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary/1/task_1426266260362_0018_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary dst=null perm=null
2015-03-13 10:09:46,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,322 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,325 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,339 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62310, dest: /127.0.0.1:60696, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5494929000
2015-03-13 10:09:46,339 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,340 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62309, dest: /127.0.0.1:60686, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5495935000
2015-03-13 10:09:46,340 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,342 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62308, dest: /127.0.0.1:60689, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 5497569000
2015-03-13 10:09:46,342 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742037_1213{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,344 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,347 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:46,349 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62326 dest: /127.0.0.1:60696
2015-03-13 10:09:46,350 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62327 dest: /127.0.0.1:60693
2015-03-13 10:09:46,351 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215 src: /127.0.0.1:62328 dest: /127.0.0.1:60686
2015-03-13 10:09:46,354 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62328, dest: /127.0.0.1:60686, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 1245000
2015-03-13 10:09:46,354 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,355 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,355 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62327, dest: /127.0.0.1:60693, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 1730000
2015-03-13 10:09:46,355 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,356 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62326, dest: /127.0.0.1:60696, bytes: 451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 2515000
2015-03-13 10:09:46,356 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,356 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,357 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742039_1215{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:46,358 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist dst=null perm=null
2015-03-13 10:09:46,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:46,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist dst=null perm=null
2015-03-13 10:09:46,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:09:46,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1.jhist dst=null perm=null
2015-03-13 10:09:46,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,378 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62329, bytes: 75315, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213, duration: 315000
2015-03-13 10:09:46,380 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:46,381 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62330 dest: /127.0.0.1:60689
2015-03-13 10:09:46,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62331 dest: /127.0.0.1:60693
2015-03-13 10:09:46,384 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216 src: /127.0.0.1:62332 dest: /127.0.0.1:60696
2015-03-13 10:09:46,388 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62332, dest: /127.0.0.1:60696, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 2017000
2015-03-13 10:09:46,388 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,388 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,389 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62331, dest: /127.0.0.1:60693, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 2706000
2015-03-13 10:09:46,389 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,389 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,389 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62330, dest: /127.0.0.1:60689, bytes: 74731, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, duration: 3623000
2015-03-13 10:09:46,390 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,390 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742040_1216{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:46,391 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml dst=null perm=null
2015-03-13 10:09:46,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:46,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml dst=null perm=null
2015-03-13 10:09:46,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp dst=null perm=null
2015-03-13 10:09:46,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018/job_1426266260362_0018_1_conf.xml dst=null perm=null
2015-03-13 10:09:46,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:46,403 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62333, bytes: 93574, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742036_1212, duration: 271000
2015-03-13 10:09:46,405 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:46,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62334 dest: /127.0.0.1:60693
2015-03-13 10:09:46,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62335 dest: /127.0.0.1:60696
2015-03-13 10:09:46,410 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217 src: /127.0.0.1:62336 dest: /127.0.0.1:60689
2015-03-13 10:09:46,413 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62336, dest: /127.0.0.1:60689, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 2004000
2015-03-13 10:09:46,413 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:46,414 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,414 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62335, dest: /127.0.0.1:60696, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 2675000
2015-03-13 10:09:46,414 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,415 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,415 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62334, dest: /127.0.0.1:60693, bytes: 92846, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-869631751_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, duration: 3451000
2015-03-13 10:09:46,415 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:46,415 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742041_1217{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:46,417 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-869631751_1
2015-03-13 10:09:46,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:09:46,431 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from RUNNING to FINISHING
2015-03-13 10:09:46,431 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0018
2015-03-13 10:09:46,432 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from RUNNING to REMOVING
2015-03-13 10:09:46,432 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0018
2015-03-13 10:09:46,432 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from REMOVING to FINISHING
2015-03-13 10:09:46,444 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:47,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:09:47,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000008
2015-03-13 10:09:47,294 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:47,294 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:09:47,294 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000008
2015-03-13 10:09:47,294 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:09:47,294 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:09:47,294 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000008, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:47,295 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:47,295 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:09:47,295 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000008 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:09:47,438 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742032_1208 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:09:47,439 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742033_1209 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:09:47,439 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742034_1210 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:09:47,439 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742035_1211 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:09:47,439 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742037_1213 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:09:47,440 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742036_1212 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:09:47,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0018 dst=null perm=null
2015-03-13 10:09:47,447 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:47,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,474 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary
2015-03-13 10:09:47,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/_temporary dst=null perm=null
2015-03-13 10:09:47,481 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,482 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,485 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2015-03-13 10:09:47,487 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62338, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 183000
2015-03-13 10:09:47,494 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,494 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,494 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,497 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2015-03-13 10:09:47,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62339, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 182000
2015-03-13 10:09:47,500 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby
2015-03-13 10:09:47,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby dst=null perm=null
2015-03-13 10:09:47,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2015-03-13 10:09:47,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintogroupby/part-00000 dst=null perm=null
2015-03-13 10:09:47,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62339, bytes: 340, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214, duration: 164000
2015-03-13 10:09:47,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:47,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:09:47,514 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,516 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:09:47,516 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:09:47,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:09:47,525 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown"]
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:09:47,526 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:09:47,527 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...ldedpipesplatform/unknown
2015-03-13 10:09:47,534 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,542 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:09:47,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:47,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:47,546 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 19
2015-03-13 10:09:47,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=null
2015-03-13 10:09:47,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:09:47,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:09:47,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:47,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,553 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:09:47,554 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62341 dest: /127.0.0.1:60693
2015-03-13 10:09:47,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62342 dest: /127.0.0.1:60689
2015-03-13 10:09:47,557 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62343 dest: /127.0.0.1:60686
2015-03-13 10:09:47,561 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62343, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 1899000
2015-03-13 10:09:47,561 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,561 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,562 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62342, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 2903000
2015-03-13 10:09:47,562 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,562 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,562 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62341, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 3837000
2015-03-13 10:09:47,563 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,563 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742042_1218{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:09:47,564 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,565 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar
2015-03-13 10:09:47,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:47,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:47,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:47,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:47,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:09:47,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:09:47,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:09:47,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:09:47,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:09:47,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:47,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:47,576 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:09:47,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:09:47,578 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,580 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split
2015-03-13 10:09:47,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:47,582 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:47,583 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62344 dest: /127.0.0.1:60686
2015-03-13 10:09:47,584 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62345 dest: /127.0.0.1:60693
2015-03-13 10:09:47,585 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62346 dest: /127.0.0.1:60696
2015-03-13 10:09:47,587 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219 src: /127.0.0.1:62347 dest: /127.0.0.1:60689
2015-03-13 10:09:47,590 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62347, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 1347000
2015-03-13 10:09:47,590 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,591 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,591 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62346, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 1829000
2015-03-13 10:09:47,591 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,592 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,592 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62345, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 3021000
2015-03-13 10:09:47,592 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,592 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,593 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62344, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 3575000
2015-03-13 10:09:47,593 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,593 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742043_1219{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,594 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,595 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,597 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:09:47,599 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62348 dest: /127.0.0.1:60686
2015-03-13 10:09:47,600 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62349 dest: /127.0.0.1:60693
2015-03-13 10:09:47,601 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220 src: /127.0.0.1:62350 dest: /127.0.0.1:60696
2015-03-13 10:09:47,604 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62350, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 1106000
2015-03-13 10:09:47,604 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,604 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,604 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62349, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 1516000
2015-03-13 10:09:47,605 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,605 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,605 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62348, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 2381000
2015-03-13 10:09:47,605 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,606 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742044_1220{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:09:47,607 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,607 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:09:47,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:09:47,611 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:09:47,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:09:47,612 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:09:47,616 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:47,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62351 dest: /127.0.0.1:60696
2015-03-13 10:09:47,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62352 dest: /127.0.0.1:60686
2015-03-13 10:09:47,620 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221 src: /127.0.0.1:62353 dest: /127.0.0.1:60689
2015-03-13 10:09:47,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62353, dest: /127.0.0.1:60689, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 1708000
2015-03-13 10:09:47,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:47,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62352, dest: /127.0.0.1:60686, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 1980000
2015-03-13 10:09:47,625 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,625 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62351, dest: /127.0.0.1:60696, bytes: 97638, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 2809000
2015-03-13 10:09:47,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,626 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:47,627 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742045_1221{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:47,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:09:47,628 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0019
2015-03-13 10:09:47,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=null
2015-03-13 10:09:47,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:47,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:47,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:47,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:47,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:47,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:47,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:47,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:47,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:47,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:47,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:47,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:47,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:47,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:47,640 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 19 submitted by user soberoi
2015-03-13 10:09:47,640 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0019
2015-03-13 10:09:47,640 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0019
2015-03-13 10:09:47,641 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from NEW to NEW_SAVING
2015-03-13 10:09:47,641 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0019
2015-03-13 10:09:47,641 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:09:47,641 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0019_000001
2015-03-13 10:09:47,641 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from NEW to SUBMITTED
2015-03-13 10:09:47,641 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0019 from user: soberoi activated in queue: default
2015-03-13 10:09:47,642 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0019 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:09:47,642 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0019 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:09:47,642 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0019 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:09:47,642 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0019_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:09:47,642 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:09:47,643 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from SUBMITTED to ACCEPTED
2015-03-13 10:09:47,644 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0019/
2015-03-13 10:09:47,644 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0019
2015-03-13 10:09:47,644 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0019/
2015-03-13 10:09:47,818 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:47,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:47,819 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:47,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:48,171 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:09:48,171 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:09:48,172 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0019_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:48,172 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:09:48,172 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:48,172 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:48,173 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0019 AttemptId: appattempt_1426266260362_0019_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:09:48,173 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:09:48,173 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,174 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:09:48,174 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0019_000001
2015-03-13 10:09:48,175 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,175 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0019_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:09:48,177 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:48,178 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000001 by user soberoi
2015-03-13 10:09:48,178 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:48,178 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:09:48,178 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:48,178 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000001 to application application_1426266260362_0019
2015-03-13 10:09:48,179 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0019_000001
2015-03-13 10:09:48,179 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:48,179 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:09:48,179 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:09:48,179 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:48,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,179 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,180 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:48,180 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000001
2015-03-13 10:09:48,189 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0019_01_000001.tokens. Credentials list:
2015-03-13 10:09:48,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:48,212 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,213 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:48,214 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,220 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,220 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0019_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001.tokens
2015-03-13 10:09:48,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:48,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:48,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:48,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:48,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62357, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 460000
2015-03-13 10:09:48,360 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:48,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:48,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:48,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62358, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 125000
2015-03-13 10:09:48,395 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:48,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:48,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:48,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:09:48,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62338, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 129000
2015-03-13 10:09:48,435 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:48,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:48,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:48,452 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:48,458 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62358, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1498248180_9952, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 221000
2015-03-13 10:09:48,470 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:48,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:48,494 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:48,494 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:48,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001/default_container_executor.sh]
2015-03-13 10:09:48,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:48,782 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,783 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:48,911 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742042_1218 to datanode(s) 127.0.0.1:60696
2015-03-13 10:09:48,911 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213]
2015-03-13 10:09:48,911 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742035_1211, blk_1073742036_1212, blk_1073742037_1213]
2015-03-13 10:09:48,967 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221
2015-03-13 10:09:48,968 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742040_1216
2015-03-13 10:09:48,968 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,968 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:48,969 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220
2015-03-13 10:09:48,969 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,970 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742037_1213
2015-03-13 10:09:48,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742038_1214
2015-03-13 10:09:48,983 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215
2015-03-13 10:09:48,984 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219
2015-03-13 10:09:49,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:49,173 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742041_1217
2015-03-13 10:09:49,173 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:49,454 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:49,529 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 to 127.0.0.1:60696
2015-03-13 10:09:49,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:49,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:49,530 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62359 dest: /127.0.0.1:60696
2015-03-13 10:09:49,531 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:49,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:49,531 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:09:49,531 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:49,532 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218 src: /127.0.0.1:62359 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:09:49,533 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742042_1218 size 254067
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:49,898 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:49,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:49,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:49,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:49,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:49,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:50,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:09:50,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED dst=null perm=null
2015-03-13 10:09:50,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:09:50,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_FAIL dst=null perm=null
2015-03-13 10:09:50,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:50,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=null
2015-03-13 10:09:50,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:09:50,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:09:50,459 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:50,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:50,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.splitmetainfo dst=null perm=null
2015-03-13 10:09:50,584 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62361, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742044_1220, duration: 184000
2015-03-13 10:09:51,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:51,346 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:51,347 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0019_000001
2015-03-13 10:09:51,347 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0019 APPATTEMPTID=appattempt_1426266260362_0019_000001
2015-03-13 10:09:51,348 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:09:51,348 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from ACCEPTED to RUNNING
2015-03-13 10:09:51,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:51,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:09:51,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:09:51,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:51,565 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:09:51,611 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62367 dest: /127.0.0.1:60696
2015-03-13 10:09:51,613 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62368 dest: /127.0.0.1:60693
2015-03-13 10:09:51,614 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222 src: /127.0.0.1:62369 dest: /127.0.0.1:60689
2015-03-13 10:09:51,623 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62369, dest: /127.0.0.1:60689, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 6816000
2015-03-13 10:09:51,623 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:09:51,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62368, dest: /127.0.0.1:60693, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 7471000
2015-03-13 10:09:51,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:51,625 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62367, dest: /127.0.0.1:60696, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 8506000
2015-03-13 10:09:51,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,625 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:09:51,626 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742046_1222{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:09:51,629 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:09:51,916 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742034_1210, blk_1073742037_1213]
2015-03-13 10:09:51,916 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742032_1208, blk_1073742033_1209, blk_1073742035_1211, blk_1073742036_1212]
2015-03-13 10:09:52,179 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:52,467 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:52,468 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,468 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:09:52,468 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:09:52,469 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0019_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,469 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:09:52,469 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,470 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,470 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:09:52,470 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:09:52,470 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0019_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,470 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:09:52,470 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:52,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:52,529 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034 for deletion
2015-03-13 10:09:52,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037 for deletion
2015-03-13 10:09:52,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:52,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:52,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742034_1210 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742034
2015-03-13 10:09:52,530 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742037_1213 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742037
2015-03-13 10:09:52,566 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,566 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:09:52,566 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:09:52,566 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,567 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:09:52,567 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,567 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,567 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:09:52,567 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:09:52,567 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,568 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:09:52,568 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:09:52,568 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:09:52,568 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:09:52,568 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0019 container=Container: [ContainerId: container_1426266260362_0019_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0019_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,569 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:09:52,569 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0018_01_000001 succeeded
2015-03-13 10:09:52,569 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:52,569 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:09:52,569 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0018_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:09:52,576 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,577 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0018/container_1426266260362_0018_01_000001
2015-03-13 10:09:52,576 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0018_01_000001 from application application_1426266260362_0018
2015-03-13 10:09:52,577 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:52,577 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0018
2015-03-13 10:09:52,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032 for deletion
2015-03-13 10:09:52,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033 for deletion
2015-03-13 10:09:52,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035 for deletion
2015-03-13 10:09:52,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742032_1208 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742032
2015-03-13 10:09:52,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742033_1209 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742033
2015-03-13 10:09:52,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036 for deletion
2015-03-13 10:09:52,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742035_1211 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742035
2015-03-13 10:09:52,718 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742036_1212 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742036
2015-03-13 10:09:53,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,227 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:53,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,385 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,386 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:09:53,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:53,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:53,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:53,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:53,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:53,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:09:53,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:09:53,469 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 18 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:09:53,469 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0018_01_000001
2015-03-13 10:09:53,470 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0018_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:09:53,470 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0018_000001
2015-03-13 10:09:53,470 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0018_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:09:53,470 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0018_000001 State change from FINISHING to FINISHED
2015-03-13 10:09:53,470 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0018 CONTAINERID=container_1426266260362_0018_01_000001
2015-03-13 10:09:53,470 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0018 State change from FINISHING to FINISHED
2015-03-13 10:09:53,470 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0018_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:09:53,471 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:09:53,470 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0018
2015-03-13 10:09:53,471 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0018_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:53,471 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0018_000001
2015-03-13 10:09:53,471 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:09:53,471 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:09:53,471 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0018_000001 released container container_1426266260362_0018_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:09:53,471 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0018,name=[CD6FBC07BE1742EBBA4ED3E85D978DBA/D4DC90FFC72F4258815AC79ED379D06A] merging/(1/1) ...platform/joinsintogroupby,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0018/jobhistory/job/job_1426266260362_0018,appMasterHost=Edinburgh.local,startTime=1426266563882,finishTime=1426266586432,finalStatus=SUCCEEDED
2015-03-13 10:09:53,471 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0018_000001 is done. finalState=FINISHED
2015-03-13 10:09:53,471 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0018 requests cleared
2015-03-13 10:09:53,472 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0018 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:09:53,472 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0018 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:09:53,473 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0018_000001 (auth:SIMPLE)
2015-03-13 10:09:53,474 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0018_01_000001
2015-03-13 10:09:53,515 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:53,515 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:09:53,518 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000002 by user soberoi
2015-03-13 10:09:53,518 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:53,518 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000006 by user soberoi
2015-03-13 10:09:53,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0019
2015-03-13 10:09:53,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000005 by user soberoi
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:53,518 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000004 by user soberoi
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000002 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from NEW to INITING
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000006 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000005 to application application_1426266260362_0019
2015-03-13 10:09:53,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:09:53,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:09:53,519 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0019_01_000003 by user soberoi
2015-03-13 10:09:53,518 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:09:53,520 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000004 to application application_1426266260362_0019
2015-03-13 10:09:53,521 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:53,521 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,521 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,519 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from INITING to RUNNING
2015-03-13 10:09:53,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:09:53,521 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,522 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0019_01_000003 to application application_1426266260362_0019
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,522 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,521 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,522 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,522 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,523 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,523 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,523 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,523 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,523 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000005
2015-03-13 10:09:53,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:09:53,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:09:53,524 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000006
2015-03-13 10:09:53,524 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000002
2015-03-13 10:09:53,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000004
2015-03-13 10:09:53,525 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,525 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0019
2015-03-13 10:09:53,525 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:09:53,525 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0019
2015-03-13 10:09:53,525 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0019_01_000003
2015-03-13 10:09:53,548 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000002.tokens. Credentials list:
2015-03-13 10:09:53,549 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000005.tokens. Credentials list:
2015-03-13 10:09:53,550 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000003.tokens. Credentials list:
2015-03-13 10:09:53,551 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0019_01_000004.tokens. Credentials list:
2015-03-13 10:09:53,551 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000006.tokens. Credentials list:
2015-03-13 10:09:53,567 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:53,567 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,568 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:53,571 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:53,572 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:53,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002.tokens
2015-03-13 10:09:53,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005.tokens
2015-03-13 10:09:53,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:53,651 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:53,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar dst=null perm=null
2015-03-13 10:09:53,732 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62377, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1448181493_10100, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 496000
2015-03-13 10:09:53,732 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62378, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_707313140_10099, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218, duration: 415000
2015-03-13 10:09:53,752 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,752 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml dst=null perm=null
2015-03-13 10:09:53,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62378, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1448181493_10100, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 232000
2015-03-13 10:09:53,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62379, bytes: 98402, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_707313140_10099, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742045_1221, duration: 353000
2015-03-13 10:09:53,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:09:53,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:09:53,840 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,840 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,847 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,847 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,848 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,848 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,848 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:09:53,849 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:09:53,981 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003/default_container_executor.sh]
2015-03-13 10:09:53,982 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002/default_container_executor.sh]
2015-03-13 10:09:53,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004/default_container_executor.sh]
2015-03-13 10:09:53,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005/default_container_executor.sh]
2015-03-13 10:09:54,016 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006/default_container_executor.sh]
2015-03-13 10:09:54,179 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222
2015-03-13 10:09:54,181 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742042_1218
2015-03-13 10:09:54,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,185 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,186 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,185 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,186 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,312 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,314 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,313 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,315 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,316 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,403 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:09:54,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,471 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:09:54,471 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:54,471 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:09:54,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,472 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,472 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0018
2015-03-13 10:09:54,472 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0018 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:09:54,472 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0018, with delay of 10800 seconds
2015-03-13 10:09:54,472 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0018
2015-03-13 10:09:54,570 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,571 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,571 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:54,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:54,825 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:54,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0019_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003.tokens
2015-03-13 10:09:54,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0019_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006.tokens
2015-03-13 10:09:54,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:54,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:55,069 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:09:55,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0019_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004.tokens
2015-03-13 10:09:55,191 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:09:55,474 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,474 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,577 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:55,577 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,189 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,477 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,477 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:56,579 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,482 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,482 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:57,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,197 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:58,585 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:09:59,587 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:00,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,205 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,502 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,502 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:01,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:10:01,904 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62391, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 180000
2015-03-13 10:10:01,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:10:01,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:10:02,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:10:02,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:02,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62391, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 140000
2015-03-13 10:10:02,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job.split dst=null perm=null
2015-03-13 10:10:02,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62395, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 155000
2015-03-13 10:10:02,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,136 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62396, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 147000
2015-03-13 10:10:02,184 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62398, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 154000
2015-03-13 10:10:02,209 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,256 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62399, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742043_1219, duration: 170000
2015-03-13 10:10:02,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:02,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:02,282 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62400, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 157000
2015-03-13 10:10:02,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:02,324 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62401, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:10:02,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:02,376 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62402, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 158000
2015-03-13 10:10:02,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:02,505 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,506 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62403, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:02,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,607 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:02,648 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62404 dest: /127.0.0.1:60689
2015-03-13 10:10:02,649 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62405 dest: /127.0.0.1:60693
2015-03-13 10:10:02,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223 src: /127.0.0.1:62406 dest: /127.0.0.1:60696
2015-03-13 10:10:02,659 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62406, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 6857000
2015-03-13 10:10:02,659 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,660 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,660 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62405, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 7488000
2015-03-13 10:10:02,660 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,661 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62404, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 8368000
2015-03-13 10:10:02,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,661 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742047_1223{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:02,666 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0019_m_000002_0_543333481_1
2015-03-13 10:10:02,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0 dst=null perm=null
2015-03-13 10:10:02,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0 dst=null perm=null
2015-03-13 10:10:02,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002 dst=null perm=null
2015-03-13 10:10:02,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,706 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,706 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000004
2015-03-13 10:10:02,706 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,706 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,707 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,719 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000004 is : 143
2015-03-13 10:10:02,721 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:02,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62407 dest: /127.0.0.1:60696
2015-03-13 10:10:02,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62408 dest: /127.0.0.1:60689
2015-03-13 10:10:02,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224 src: /127.0.0.1:62409 dest: /127.0.0.1:60693
2015-03-13 10:10:02,730 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist for DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:02,732 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,733 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,733 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,733 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,733 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000004 from application application_1426266260362_0019
2015-03-13 10:10:02,733 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,733 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,734 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000004
2015-03-13 10:10:02,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,807 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62410, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:10:02,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,828 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62396, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:02,834 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:02,835 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62411, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 137000
2015-03-13 10:10:02,864 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:02,875 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62412 dest: /127.0.0.1:60689
2015-03-13 10:10:02,877 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62414 dest: /127.0.0.1:60686
2015-03-13 10:10:02,878 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225 src: /127.0.0.1:62415 dest: /127.0.0.1:60693
2015-03-13 10:10:02,887 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62415, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 7312000
2015-03-13 10:10:02,887 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,887 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,888 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62414, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 8077000
2015-03-13 10:10:02,888 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,888 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,888 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62412, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 8804000
2015-03-13 10:10:02,889 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,889 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742049_1225{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:02,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,893 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0019_m_000001_0_1288041849_1
2015-03-13 10:10:02,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0 dst=null perm=null
2015-03-13 10:10:02,903 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0 dst=null perm=null
2015-03-13 10:10:02,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001 dst=null perm=null
2015-03-13 10:10:02,909 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62413 dest: /127.0.0.1:60686
2015-03-13 10:10:02,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62416 dest: /127.0.0.1:60693
2015-03-13 10:10:02,912 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62398, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 157000
2015-03-13 10:10:02,913 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226 src: /127.0.0.1:62417 dest: /127.0.0.1:60689
2015-03-13 10:10:02,921 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62417, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 7379000
2015-03-13 10:10:02,922 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:02,922 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,923 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62416, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 8344000
2015-03-13 10:10:02,923 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,923 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62413, dest: /127.0.0.1:60686, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 9311000
2015-03-13 10:10:02,924 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:02,923 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,924 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742050_1226{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:02,929 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000003
2015-03-13 10:10:02,929 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0019_m_000000_0_1517633601_1
2015-03-13 10:10:02,930 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,929 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,930 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000003
2015-03-13 10:10:02,930 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,930 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,942 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000003 is : 143
2015-03-13 10:10:02,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0 dst=null perm=null
2015-03-13 10:10:02,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0 dst=null perm=null
2015-03-13 10:10:02,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000 dst=null perm=null
2015-03-13 10:10:02,954 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000003
2015-03-13 10:10:02,955 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,956 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000003 from application application_1426266260362_0019
2015-03-13 10:10:02,956 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,956 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,960 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0019_m_000004_0_700671599_1
2015-03-13 10:10:02,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,967 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,967 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000002
2015-03-13 10:10:02,967 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,967 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:02,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000003
2015-03-13 10:10:02,968 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:02,968 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:02,968 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000003
2015-03-13 10:10:02,968 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:02,968 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:02,968 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,969 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,969 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:02,969 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000003 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:02,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0 dst=null perm=null
2015-03-13 10:10:02,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,980 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000002 is : 143
2015-03-13 10:10:02,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:02,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0 dst=null perm=null
2015-03-13 10:10:02,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004 dst=null perm=null
2015-03-13 10:10:02,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:02,988 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62418, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 131000
2015-03-13 10:10:02,992 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:02,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:02,993 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:02,993 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000002 from application application_1426266260362_0019
2015-03-13 10:10:02,993 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:02,993 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:02,997 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:02,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:02,997 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000006
2015-03-13 10:10:02,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000004
2015-03-13 10:10:02,997 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:02,998 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:02,998 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:02,998 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:02,998 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000004
2015-03-13 10:10:02,998 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:02,998 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:02,999 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:02,999 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:02,999 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:03,009 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000006 is : 143
2015-03-13 10:10:03,016 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:03,020 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:03,020 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,020 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000006
2015-03-13 10:10:03,021 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:03,022 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:03,023 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000006 from application application_1426266260362_0019
2015-03-13 10:10:03,023 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:03,023 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:03,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62419 dest: /127.0.0.1:60686
2015-03-13 10:10:03,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62420 dest: /127.0.0.1:60689
2015-03-13 10:10:03,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227 src: /127.0.0.1:62421 dest: /127.0.0.1:60693
2015-03-13 10:10:03,064 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62421, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 7512000
2015-03-13 10:10:03,065 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,065 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,065 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62420, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 8111000
2015-03-13 10:10:03,065 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,066 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,066 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62419, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 8810000
2015-03-13 10:10:03,066 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,066 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742051_1227{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,073 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0019_m_000003_0_154307093_1
2015-03-13 10:10:03,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0 dst=null perm=null
2015-03-13 10:10:03,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0 dst=null perm=null
2015-03-13 10:10:03,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003 dst=null perm=null
2015-03-13 10:10:03,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/_temporary/attempt_1426266260362_0019_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:03,096 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000005
2015-03-13 10:10:03,096 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:03,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:03,097 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000005
2015-03-13 10:10:03,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:03,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:03,097 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000006
2015-03-13 10:10:03,097 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:03,098 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:03,098 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000006
2015-03-13 10:10:03,098 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:03,098 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:03,098 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,098 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,098 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:03,098 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:03,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,103 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,107 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1 dst=null perm=null
2015-03-13 10:10:03,108 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0019_01_000005 is : 143
2015-03-13 10:10:03,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000 dst=null perm=null
2015-03-13 10:10:03,117 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2015-03-13 10:10:03,120 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:03,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:03,121 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:03,122 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000005 from application application_1426266260362_0019
2015-03-13 10:10:03,122 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:03,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:03,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001 dst=null perm=null
2015-03-13 10:10:03,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2015-03-13 10:10:03,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002 dst=null perm=null
2015-03-13 10:10:03,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2015-03-13 10:10:03,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003 dst=null perm=null
2015-03-13 10:10:03,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2015-03-13 10:10:03,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:03,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004 dst=null perm=null
2015-03-13 10:10:03,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2015-03-13 10:10:03,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary/1/task_1426266260362_0019_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary dst=null perm=null
2015-03-13 10:10:03,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,157 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,161 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,176 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62409, dest: /127.0.0.1:60693, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 449311000
2015-03-13 10:10:03,176 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,177 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,178 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62408, dest: /127.0.0.1:60689, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 450537000
2015-03-13 10:10:03,178 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,179 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,179 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62407, dest: /127.0.0.1:60696, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 452096000
2015-03-13 10:10:03,180 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,180 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742048_1224{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:03,181 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,187 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:03,188 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62422 dest: /127.0.0.1:60686
2015-03-13 10:10:03,190 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62423 dest: /127.0.0.1:60696
2015-03-13 10:10:03,192 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228 src: /127.0.0.1:62424 dest: /127.0.0.1:60689
2015-03-13 10:10:03,195 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62424, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 1248000
2015-03-13 10:10:03,195 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,195 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,196 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62423, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 1658000
2015-03-13 10:10:03,196 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,196 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,196 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62422, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 2423000
2015-03-13 10:10:03,196 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,197 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742052_1228{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,198 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist dst=null perm=null
2015-03-13 10:10:03,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:03,212 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:03,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist dst=null perm=null
2015-03-13 10:10:03,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:03,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1.jhist dst=null perm=null
2015-03-13 10:10:03,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,221 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62425, bytes: 53700, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224, duration: 195000
2015-03-13 10:10:03,223 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:03,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62426 dest: /127.0.0.1:60693
2015-03-13 10:10:03,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62427 dest: /127.0.0.1:60696
2015-03-13 10:10:03,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229 src: /127.0.0.1:62428 dest: /127.0.0.1:60689
2015-03-13 10:10:03,235 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62428, dest: /127.0.0.1:60689, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5292000
2015-03-13 10:10:03,235 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:03,235 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,236 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:03,236 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62427, dest: /127.0.0.1:60696, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5256000
2015-03-13 10:10:03,236 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,236 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:03,237 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62426, dest: /127.0.0.1:60693, bytes: 53280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, duration: 5871000
2015-03-13 10:10:03,237 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,237 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,238 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,238 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:03,238 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,238 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:03,239 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742053_1229{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:03,240 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml dst=null perm=null
2015-03-13 10:10:03,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:03,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml dst=null perm=null
2015-03-13 10:10:03,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:03,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019/job_1426266260362_0019_1_conf.xml dst=null perm=null
2015-03-13 10:10:03,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:03,254 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62429, bytes: 91159, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742046_1222, duration: 265000
2015-03-13 10:10:03,256 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:03,257 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62430 dest: /127.0.0.1:60693
2015-03-13 10:10:03,259 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62431 dest: /127.0.0.1:60689
2015-03-13 10:10:03,260 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230 src: /127.0.0.1:62432 dest: /127.0.0.1:60696
2015-03-13 10:10:03,264 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62432, dest: /127.0.0.1:60696, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 1830000
2015-03-13 10:10:03,264 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:03,265 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,265 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62431, dest: /127.0.0.1:60689, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 2657000
2015-03-13 10:10:03,265 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,266 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,267 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62430, dest: /127.0.0.1:60693, bytes: 90451, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-602048742_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, duration: 4181000
2015-03-13 10:10:03,267 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:03,267 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742054_1230{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:03,269 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-602048742_1
2015-03-13 10:10:03,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:03,284 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:03,284 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0019
2015-03-13 10:10:03,285 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from RUNNING to REMOVING
2015-03-13 10:10:03,285 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0019
2015-03-13 10:10:03,285 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from REMOVING to FINISHING
2015-03-13 10:10:03,426 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:03,426 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:03,427 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:03,427 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,428 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,428 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:03,428 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:03,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:03,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000002
2015-03-13 10:10:03,973 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:03,973 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:03,973 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000002
2015-03-13 10:10:03,974 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:03,974 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:03,974 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,974 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:03,974 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:03,975 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000002 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:03,990 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226
2015-03-13 10:10:03,990 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227
2015-03-13 10:10:03,991 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:03,991 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225
2015-03-13 10:10:04,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:04,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000005
2015-03-13 10:10:04,103 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:04,103 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:04,103 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000005
2015-03-13 10:10:04,104 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:04,104 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:04,104 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,104 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,104 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:04,104 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000005 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:04,189 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:04,189 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742053_1229
2015-03-13 10:10:04,190 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228
2015-03-13 10:10:04,190 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742048_1224
2015-03-13 10:10:04,190 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223
2015-03-13 10:10:04,213 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:04,296 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742042_1218 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:10:04,296 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742043_1219 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:10:04,296 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742044_1220 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:10:04,296 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742045_1221 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:10:04,296 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742048_1224 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:10:04,297 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742046_1222 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:10:04,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0019 dst=null perm=null
2015-03-13 10:10:04,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,334 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary
2015-03-13 10:10:04,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/_temporary dst=null perm=null
2015-03-13 10:10:04,341 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,341 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,342 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,345 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:04,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2015-03-13 10:10:04,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 154000
2015-03-13 10:10:04,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2015-03-13 10:10:04,350 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 170000
2015-03-13 10:10:04,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2015-03-13 10:10:04,352 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 168000
2015-03-13 10:10:04,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2015-03-13 10:10:04,354 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 173000
2015-03-13 10:10:04,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2015-03-13 10:10:04,361 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,361 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,362 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,365 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:04,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2015-03-13 10:10:04,368 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 187000
2015-03-13 10:10:04,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2015-03-13 10:10:04,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 127000
2015-03-13 10:10:04,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2015-03-13 10:10:04,372 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62437, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 174000
2015-03-13 10:10:04,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2015-03-13 10:10:04,374 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 155000
2015-03-13 10:10:04,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2015-03-13 10:10:04,375 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/unknown
2015-03-13 10:10:04,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown dst=null perm=null
2015-03-13 10:10:04,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2015-03-13 10:10:04,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00000 dst=null perm=null
2015-03-13 10:10:04,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742050_1226, duration: 161000
2015-03-13 10:10:04,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2015-03-13 10:10:04,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00001 dst=null perm=null
2015-03-13 10:10:04,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742049_1225, duration: 156000
2015-03-13 10:10:04,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2015-03-13 10:10:04,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00002 dst=null perm=null
2015-03-13 10:10:04,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742047_1223, duration: 123000
2015-03-13 10:10:04,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2015-03-13 10:10:04,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00003 dst=null perm=null
2015-03-13 10:10:04,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742051_1227, duration: 111000
2015-03-13 10:10:04,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2015-03-13 10:10:04,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/unknown/part-00004 dst=null perm=null
2015-03-13 10:10:04,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:04,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:04,396 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,397 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:04,397 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:04,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:04,415 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost"]
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] parallel execution is enabled: true
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting jobs: 1
2015-03-13 10:10:04,416 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] allocating threads: 1
2015-03-13 10:10:04,419 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (1/1) ...m/joinaroundjoinrightmost
2015-03-13 10:10:04,425 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,435 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:04,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:04,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:04,440 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 20
2015-03-13 10:10:04,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=null
2015-03-13 10:10:04,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:04,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:10:04,444 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:04,446 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,448 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:04,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62439 dest: /127.0.0.1:60693
2015-03-13 10:10:04,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62440 dest: /127.0.0.1:60689
2015-03-13 10:10:04,451 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62441 dest: /127.0.0.1:60686
2015-03-13 10:10:04,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62441, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 4199000
2015-03-13 10:10:04,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,458 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62440, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 2264000
2015-03-13 10:10:04,458 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,458 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62439, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 5691000
2015-03-13 10:10:04,459 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,460 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742055_1231{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,460 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,461 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar
2015-03-13 10:10:04,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:04,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:04,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:04,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:04,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:10:04,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:10:04,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:10:04,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:10:04,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:10:04,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:04,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:04,473 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:04,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:04,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,477 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split
2015-03-13 10:10:04,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:04,478 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:04,480 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62442 dest: /127.0.0.1:60689
2015-03-13 10:10:04,481 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62443 dest: /127.0.0.1:60696
2015-03-13 10:10:04,482 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62444 dest: /127.0.0.1:60686
2015-03-13 10:10:04,483 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232 src: /127.0.0.1:62445 dest: /127.0.0.1:60693
2015-03-13 10:10:04,485 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62445, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 1665000
2015-03-13 10:10:04,485 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,486 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,486 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62444, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 1988000
2015-03-13 10:10:04,486 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,486 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,487 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62443, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 2772000
2015-03-13 10:10:04,487 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,487 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,487 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62442, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 3207000
2015-03-13 10:10:04,487 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,488 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742056_1232{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:04,489 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,492 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:04,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62446 dest: /127.0.0.1:60689
2015-03-13 10:10:04,495 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62447 dest: /127.0.0.1:60693
2015-03-13 10:10:04,496 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233 src: /127.0.0.1:62448 dest: /127.0.0.1:60686
2015-03-13 10:10:04,498 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62448, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 1278000
2015-03-13 10:10:04,498 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,498 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,499 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62447, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 1782000
2015-03-13 10:10:04,499 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,499 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62446, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 2667000
2015-03-13 10:10:04,500 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,501 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742057_1233{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:04,502 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,502 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:04,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:04,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:04,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:04,506 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:04,511 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:04,512 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62449 dest: /127.0.0.1:60689
2015-03-13 10:10:04,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62450 dest: /127.0.0.1:60693
2015-03-13 10:10:04,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234 src: /127.0.0.1:62451 dest: /127.0.0.1:60696
2015-03-13 10:10:04,518 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62451, dest: /127.0.0.1:60696, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 1499000
2015-03-13 10:10:04,518 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:04,519 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,519 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62450, dest: /127.0.0.1:60693, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 1911000
2015-03-13 10:10:04,519 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,519 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,520 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62449, dest: /127.0.0.1:60689, bytes: 98190, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 2742000
2015-03-13 10:10:04,520 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:04,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742058_1234{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:04,521 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:04,521 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0020
2015-03-13 10:10:04,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=null
2015-03-13 10:10:04,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:04,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:04,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:04,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:04,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:04,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:04,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:04,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:04,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:04,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:04,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:04,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:04,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:04,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:04,533 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 20 submitted by user soberoi
2015-03-13 10:10:04,533 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0020
2015-03-13 10:10:04,534 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0020
2015-03-13 10:10:04,534 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0020
2015-03-13 10:10:04,534 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from NEW to NEW_SAVING
2015-03-13 10:10:04,534 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:04,534 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,534 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:04,534 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0020 from user: soberoi activated in queue: default
2015-03-13 10:10:04,535 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0020 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:04,535 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0020 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:04,535 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0020 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:04,535 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0020_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:04,535 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:04,539 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:04,541 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0020/
2015-03-13 10:10:04,541 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0020
2015-03-13 10:10:04,541 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0020/
2015-03-13 10:10:04,978 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:04,978 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:04,978 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:04,979 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0020_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,979 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:04,979 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:04,979 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:04,980 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0020 AttemptId: appattempt_1426266260362_0020_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:04,980 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:04,980 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:04,981 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,981 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0020_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:10:04,983 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:04,985 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000001 by user soberoi
2015-03-13 10:10:04,985 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:04,985 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:04,985 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:04,985 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000001 to application application_1426266260362_0020
2015-03-13 10:10:04,985 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:04,985 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0020_000001
2015-03-13 10:10:04,986 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:04,986 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:04,986 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:04,986 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:04,986 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000001
2015-03-13 10:10:04,996 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0020_01_000001.tokens. Credentials list:
2015-03-13 10:10:05,014 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:05,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0020_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001.tokens
2015-03-13 10:10:05,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:05,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:05,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:05,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:05,150 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62435, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 459000
2015-03-13 10:10:05,173 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:05,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:05,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:05,196 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62436, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 170000
2015-03-13 10:10:05,208 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,218 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:05,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:05,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:05,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:05,231 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62437, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 167000
2015-03-13 10:10:05,242 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:05,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:05,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:05,270 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62434, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1037748226_10503, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 252000
2015-03-13 10:10:05,284 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:05,284 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:05,307 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:05,307 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:05,381 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001/default_container_executor.sh]
2015-03-13 10:10:05,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:05,978 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:06,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:06,931 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742055_1231 to datanode(s) 127.0.0.1:60696
2015-03-13 10:10:06,931 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742045_1221, blk_1073742046_1222]
2015-03-13 10:10:06,931 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742046_1222]
2015-03-13 10:10:06,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:06,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED dst=null perm=null
2015-03-13 10:10:06,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:10:06,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_FAIL dst=null perm=null
2015-03-13 10:10:06,982 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:07,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=null
2015-03-13 10:10:07,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:10:07,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:10:07,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:07,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:07,284 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:07,337 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62456, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233, duration: 139000
2015-03-13 10:10:07,542 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 to 127.0.0.1:60696
2015-03-13 10:10:07,544 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62459 dest: /127.0.0.1:60696
2015-03-13 10:10:07,544 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:10:07,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231 src: /127.0.0.1:62459 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:10:07,547 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742055_1231 size 254067
2015-03-13 10:10:07,733 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:07,733 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:07,733 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:07,733 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:07,733 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:07,734 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:07,734 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:07,734 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:07,735 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:07,735 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:07,915 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:07,916 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:07,984 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,079 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:08,080 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0020_000001
2015-03-13 10:10:08,080 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0020 APPATTEMPTID=appattempt_1426266260362_0020_000001
2015-03-13 10:10:08,080 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:08,080 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from ACCEPTED to RUNNING
2015-03-13 10:10:08,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:08,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:08,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:08,223 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:08,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:08,243 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:08,291 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:08,330 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62463 dest: /127.0.0.1:60686
2015-03-13 10:10:08,332 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62464 dest: /127.0.0.1:60689
2015-03-13 10:10:08,334 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235 src: /127.0.0.1:62465 dest: /127.0.0.1:60696
2015-03-13 10:10:08,341 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62465, dest: /127.0.0.1:60696, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 6268000
2015-03-13 10:10:08,342 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:08,342 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62464, dest: /127.0.0.1:60689, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 6629000
2015-03-13 10:10:08,343 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:08,343 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,344 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62463, dest: /127.0.0.1:60686, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 7772000
2015-03-13 10:10:08,344 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:08,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,345 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742059_1235{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:08,349 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:08,436 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:08,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:08,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:08,438 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:08,449 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:08,449 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:08,648 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742054_1230
2015-03-13 10:10:08,985 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:08,999 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742057_1233
2015-03-13 10:10:09,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:09,002 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:09,002 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:09,115 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,115 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:09,115 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:09,115 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,115 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:09,115 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,116 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,116 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:09,116 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:09,116 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,116 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:09,116 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,117 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:09,117 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:09,117 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:09,117 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,117 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,117 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:09,118 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:09,118 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0020_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,118 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:09,118 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,199 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234
2015-03-13 10:10:09,200 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235
2015-03-13 10:10:09,228 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:09,228 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:09,229 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:09,229 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0020_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:10:09,229 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0020 container=Container: [ContainerId: container_1426266260362_0020_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0020_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,229 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:09,229 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:09,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231
2015-03-13 10:10:09,404 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232
2015-03-13 10:10:09,431 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0019_01_000001 succeeded
2015-03-13 10:10:09,431 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:09,431 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019/container_1426266260362_0019_01_000001
2015-03-13 10:10:09,438 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:10:09,439 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0019_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:09,439 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0019_01_000001 from application application_1426266260362_0019
2015-03-13 10:10:09,439 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:09,439 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0019
2015-03-13 10:10:09,936 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742048_1224, blk_1073742042_1218, blk_1073742043_1219, blk_1073742045_1221, blk_1073742046_1222]
2015-03-13 10:10:09,936 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742042_1218, blk_1073742043_1219, blk_1073742044_1220, blk_1073742045_1221]
2015-03-13 10:10:09,986 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:10,119 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,119 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,119 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:10,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,158 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:10,159 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:10,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:10,166 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:10,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:10,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:10,229 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 19 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:10,229 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0019_01_000001
2015-03-13 10:10:10,229 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0019_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:10,229 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0019_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:10,229 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0019_000001
2015-03-13 10:10:10,230 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0019 CONTAINERID=container_1426266260362_0019_01_000001
2015-03-13 10:10:10,230 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0019_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:10,230 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:10,230 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0019_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:10,230 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0019 State change from FINISHING to FINISHED
2015-03-13 10:10:10,230 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0019_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:10,230 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0019_000001
2015-03-13 10:10:10,230 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:10,230 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0019
2015-03-13 10:10:10,231 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0019,name=[B7ACEFEF0218423EB65E6E148EB627C7/2A3F31AD6A62450CB825E66F41825487] lower*upper/(1/1) ...ldedpipesplatform/unknown,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0019/jobhistory/job/job_1426266260362_0019,appMasterHost=Edinburgh.local,startTime=1426266587640,finishTime=1426266603285,finalStatus=SUCCEEDED
2015-03-13 10:10:10,230 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:10,231 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0019_000001 released container container_1426266260362_0019_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:10,231 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0019_000001 is done. finalState=FINISHED
2015-03-13 10:10:10,231 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0019 requests cleared
2015-03-13 10:10:10,231 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0019 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:10,231 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0019 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:10,233 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0019_000001 (auth:SIMPLE)
2015-03-13 10:10:10,234 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0019_01_000001
2015-03-13 10:10:10,244 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:10,244 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:10,247 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000002 by user soberoi
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000006 by user soberoi
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000004 by user soberoi
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0020
2015-03-13 10:10:10,248 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:10,248 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:10,248 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000002 to application application_1426266260362_0020
2015-03-13 10:10:10,248 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000004 to application application_1426266260362_0020
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000005 by user soberoi
2015-03-13 10:10:10,248 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from NEW to INITING
2015-03-13 10:10:10,249 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000006 to application application_1426266260362_0020
2015-03-13 10:10:10,249 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:10,249 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:10,249 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,249 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,249 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,249 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,249 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,249 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,248 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:10,249 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,250 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000006
2015-03-13 10:10:10,248 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from INITING to RUNNING
2015-03-13 10:10:10,248 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0020_01_000003 by user soberoi
2015-03-13 10:10:10,248 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:10,251 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:10,251 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,254 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,254 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000005 to application application_1426266260362_0020
2015-03-13 10:10:10,254 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,254 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,254 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,254 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,254 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,254 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:10,254 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0020_01_000003 to application application_1426266260362_0020
2015-03-13 10:10:10,255 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,255 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,255 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,255 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,255 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,255 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000002
2015-03-13 10:10:10,256 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:10,256 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000004
2015-03-13 10:10:10,256 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,256 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,256 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,257 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,257 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,257 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0020
2015-03-13 10:10:10,257 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:10,257 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0020
2015-03-13 10:10:10,258 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000005
2015-03-13 10:10:10,259 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0020_01_000003
2015-03-13 10:10:10,276 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0020_01_000006.tokens. Credentials list:
2015-03-13 10:10:10,276 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000002.tokens. Credentials list:
2015-03-13 10:10:10,277 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0020_01_000004.tokens. Credentials list:
2015-03-13 10:10:10,277 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0020_01_000005.tokens. Credentials list:
2015-03-13 10:10:10,277 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000003.tokens. Credentials list:
2015-03-13 10:10:10,297 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:10,298 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:10,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0020_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006.tokens
2015-03-13 10:10:10,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002.tokens
2015-03-13 10:10:10,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:10,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:10,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar dst=null perm=null
2015-03-13 10:10:10,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62473, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1551528518_10648, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 485000
2015-03-13 10:10:10,463 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62474, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1678865852_10649, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742055_1231, duration: 533000
2015-03-13 10:10:10,483 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,483 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,504 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml dst=null perm=null
2015-03-13 10:10:10,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62476, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1551528518_10648, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 237000
2015-03-13 10:10:10,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62475, bytes: 98958, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1678865852_10649, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742058_1234, duration: 294000
2015-03-13 10:10:10,524 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:10,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,524 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:10,546 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048 for deletion
2015-03-13 10:10:10,546 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:10,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:10,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:10,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046 for deletion
2015-03-13 10:10:10,547 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742048_1224 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742048
2015-03-13 10:10:10,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:10,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:10,548 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:10,549 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742046_1222 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742046
2015-03-13 10:10:10,549 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042 for deletion
2015-03-13 10:10:10,549 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043 for deletion
2015-03-13 10:10:10,550 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044 for deletion
2015-03-13 10:10:10,550 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045 for deletion
2015-03-13 10:10:10,550 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742042_1218 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742042
2015-03-13 10:10:10,550 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742043_1219 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742043
2015-03-13 10:10:10,550 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742044_1220 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742044
2015-03-13 10:10:10,551 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742045_1221 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742045
2015-03-13 10:10:10,574 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,574 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,575 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,575 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,575 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,575 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,579 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,580 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,594 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:10,594 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:10,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006/default_container_executor.sh]
2015-03-13 10:10:10,706 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002/default_container_executor.sh]
2015-03-13 10:10:10,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005/default_container_executor.sh]
2015-03-13 10:10:10,729 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004/default_container_executor.sh]
2015-03-13 10:10:10,752 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003/default_container_executor.sh]
2015-03-13 10:10:10,988 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:10,989 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:10,990 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:10,990 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:10,990 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:10,990 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,991 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:10,992 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,119 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,120 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:11,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:11,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,120 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:11,121 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:11,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,136 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:10:11,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:11,231 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:11,231 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:11,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0019
2015-03-13 10:10:11,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0019
2015-03-13 10:10:11,232 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0019 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:11,232 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0019, with delay of 10800 seconds
2015-03-13 10:10:11,557 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:11,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0020_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003.tokens
2015-03-13 10:10:11,674 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:11,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:11,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0020_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005.tokens
2015-03-13 10:10:11,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:11,990 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,041 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:12,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,120 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0020_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004.tokens
2015-03-13 10:10:12,180 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:12,232 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:12,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,125 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,126 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,237 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:13,998 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,128 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:14,238 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,003 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,131 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:15,242 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,006 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,134 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,135 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:16,246 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,013 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,137 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:17,248 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,018 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,142 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,142 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,143 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,253 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:18,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:18,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:18,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:18,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:18,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job.split dst=null perm=null
2015-03-13 10:10:18,592 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62490, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 151000
2015-03-13 10:10:18,667 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62491, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 177000
2015-03-13 10:10:18,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62492, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 151000
2015-03-13 10:10:18,691 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62493, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 177000
2015-03-13 10:10:18,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62494, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742056_1232, duration: 170000
2015-03-13 10:10:18,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:18,746 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62495, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 168000
2015-03-13 10:10:18,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:18,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:18,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62497, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 93000
2015-03-13 10:10:18,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62496, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 137000
2015-03-13 10:10:18,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:18,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,809 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62498, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 143000
2015-03-13 10:10:18,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:18,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:18,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,144 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,202 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62499, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 175000
2015-03-13 10:10:19,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,253 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:19,256 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,278 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62502, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 159000
2015-03-13 10:10:19,279 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62501, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 131000
2015-03-13 10:10:19,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,287 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,295 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0020_m_000004_0_1227176988_1
2015-03-13 10:10:19,297 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62500 dest: /127.0.0.1:60686
2015-03-13 10:10:19,299 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62503, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 150000
2015-03-13 10:10:19,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62504 dest: /127.0.0.1:60689
2015-03-13 10:10:19,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236 src: /127.0.0.1:62505 dest: /127.0.0.1:60696
2015-03-13 10:10:19,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,308 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62505, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 5922000
2015-03-13 10:10:19,308 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,308 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0 dst=null perm=null
2015-03-13 10:10:19,308 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62504, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 6669000
2015-03-13 10:10:19,309 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,308 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,309 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,310 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62500, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 8096000
2015-03-13 10:10:19,310 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,311 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742060_1236{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,315 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0020_m_000002_0_174688487_1
2015-03-13 10:10:19,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0 dst=null perm=null
2015-03-13 10:10:19,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004 dst=null perm=null
2015-03-13 10:10:19,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0 dst=null perm=null
2015-03-13 10:10:19,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0 dst=null perm=null
2015-03-13 10:10:19,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:19,333 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002 dst=null perm=null
2015-03-13 10:10:19,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,349 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000006
2015-03-13 10:10:19,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,353 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000004
2015-03-13 10:10:19,353 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,354 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,354 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000004
2015-03-13 10:10:19,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,356 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,363 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,366 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62507 dest: /127.0.0.1:60689
2015-03-13 10:10:19,368 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000004 is : 143
2015-03-13 10:10:19,368 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000006 is : 143
2015-03-13 10:10:19,368 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62508 dest: /127.0.0.1:60696
2015-03-13 10:10:19,370 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238 src: /127.0.0.1:62509 dest: /127.0.0.1:60693
2015-03-13 10:10:19,374 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist for DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,380 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,381 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,381 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000004
2015-03-13 10:10:19,383 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,383 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,383 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000004 from application application_1426266260362_0020
2015-03-13 10:10:19,383 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,384 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,384 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000006
2015-03-13 10:10:19,386 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:19,386 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,387 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000006 from application application_1426266260362_0020
2015-03-13 10:10:19,388 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,388 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,395 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:10:19,408 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62506, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:10:19,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:19,416 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:19,435 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62510 dest: /127.0.0.1:60686
2015-03-13 10:10:19,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62513 dest: /127.0.0.1:60689
2015-03-13 10:10:19,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237 src: /127.0.0.1:62514 dest: /127.0.0.1:60693
2015-03-13 10:10:19,464 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62514, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 17468000
2015-03-13 10:10:19,465 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,465 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,465 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62513, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 18186000
2015-03-13 10:10:19,465 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,466 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,466 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62510, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 19047000
2015-03-13 10:10:19,466 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,466 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742061_1237{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,481 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62512 dest: /127.0.0.1:60689
2015-03-13 10:10:19,483 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62515 dest: /127.0.0.1:60686
2015-03-13 10:10:19,484 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240 src: /127.0.0.1:62516 dest: /127.0.0.1:60693
2015-03-13 10:10:19,486 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62511 dest: /127.0.0.1:60693
2015-03-13 10:10:19,488 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62517 dest: /127.0.0.1:60689
2015-03-13 10:10:19,489 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239 src: /127.0.0.1:62518 dest: /127.0.0.1:60696
2015-03-13 10:10:19,494 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62516, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 8344000
2015-03-13 10:10:19,494 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,494 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,495 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62515, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 8948000
2015-03-13 10:10:19,495 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,495 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,495 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62512, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 9822000
2015-03-13 10:10:19,496 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,496 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742064_1240{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,497 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62518, dest: /127.0.0.1:60696, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 6788000
2015-03-13 10:10:19,498 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,498 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,498 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62517, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 7480000
2015-03-13 10:10:19,498 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,499 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62511, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 8566000
2015-03-13 10:10:19,499 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,500 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742063_1239{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:19,504 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0020_m_000001_0_-1228934246_1
2015-03-13 10:10:19,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0 dst=null perm=null
2015-03-13 10:10:19,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0 dst=null perm=null
2015-03-13 10:10:19,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001 dst=null perm=null
2015-03-13 10:10:19,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,532 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0020_m_000003_0_464453710_1
2015-03-13 10:10:19,535 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000003
2015-03-13 10:10:19,535 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,536 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,536 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000004
2015-03-13 10:10:19,536 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,536 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,536 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000003
2015-03-13 10:10:19,536 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,536 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,537 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000004
2015-03-13 10:10:19,537 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:19,537 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:19,537 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,537 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,537 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:19,537 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:19,549 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000003 is : 143
2015-03-13 10:10:19,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0 dst=null perm=null
2015-03-13 10:10:19,561 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,562 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,562 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000003
2015-03-13 10:10:19,563 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,563 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,563 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000003 from application application_1426266260362_0020
2015-03-13 10:10:19,563 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,564 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0 dst=null perm=null
2015-03-13 10:10:19,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003 dst=null perm=null
2015-03-13 10:10:19,580 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0020_m_000000_0_803283296_1
2015-03-13 10:10:19,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0 dst=null perm=null
2015-03-13 10:10:19,592 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,593 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000005
2015-03-13 10:10:19,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:19,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000003
2015-03-13 10:10:19,593 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,594 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,594 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,594 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000003
2015-03-13 10:10:19,594 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:19,594 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:19,594 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,594 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,595 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:19,595 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000003 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:19,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0 dst=null perm=null
2015-03-13 10:10:19,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000 dst=null perm=null
2015-03-13 10:10:19,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/_temporary/attempt_1426266260362_0020_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:19,605 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000005 is : 143
2015-03-13 10:10:19,617 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000005
2015-03-13 10:10:19,618 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,619 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,619 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000005 from application application_1426266260362_0020
2015-03-13 10:10:19,619 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,619 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,633 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000002
2015-03-13 10:10:19,633 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:19,633 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:19,634 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000002
2015-03-13 10:10:19,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:19,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:19,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000005
2015-03-13 10:10:19,634 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:19,635 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:19,635 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000005
2015-03-13 10:10:19,635 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:19,635 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:19,635 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,635 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:19,635 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:19,635 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:19,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,640 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1 dst=null perm=null
2015-03-13 10:10:19,646 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0020_01_000002 is : 143
2015-03-13 10:10:19,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000 dst=null perm=null
2015-03-13 10:10:19,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2015-03-13 10:10:19,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,661 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:19,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000002
2015-03-13 10:10:19,664 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:19,664 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:19,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,664 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000002 from application application_1426266260362_0020
2015-03-13 10:10:19,664 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:19,664 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:19,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001 dst=null perm=null
2015-03-13 10:10:19,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2015-03-13 10:10:19,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002 dst=null perm=null
2015-03-13 10:10:19,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2015-03-13 10:10:19,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,678 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003 dst=null perm=null
2015-03-13 10:10:19,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2015-03-13 10:10:19,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:19,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004 dst=null perm=null
2015-03-13 10:10:19,684 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2015-03-13 10:10:19,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary/1/task_1426266260362_0020_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary dst=null perm=null
2015-03-13 10:10:19,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,694 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,697 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,711 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62509, dest: /127.0.0.1:60693, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 339542000
2015-03-13 10:10:19,711 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,712 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,712 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62508, dest: /127.0.0.1:60696, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 340528000
2015-03-13 10:10:19,713 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,713 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,714 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62507, dest: /127.0.0.1:60689, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 342180000
2015-03-13 10:10:19,714 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,714 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742062_1238{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,716 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,720 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:19,722 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62519 dest: /127.0.0.1:60696
2015-03-13 10:10:19,724 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62520 dest: /127.0.0.1:60689
2015-03-13 10:10:19,725 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241 src: /127.0.0.1:62521 dest: /127.0.0.1:60686
2015-03-13 10:10:19,728 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62521, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 1297000
2015-03-13 10:10:19,728 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,729 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,729 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62520, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 1690000
2015-03-13 10:10:19,729 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,729 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,730 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62519, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 2450000
2015-03-13 10:10:19,730 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,730 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742065_1241{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,732 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist dst=null perm=null
2015-03-13 10:10:19,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:19,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist dst=null perm=null
2015-03-13 10:10:19,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:19,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1.jhist dst=null perm=null
2015-03-13 10:10:19,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,751 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62522, bytes: 53750, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238, duration: 190000
2015-03-13 10:10:19,753 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:19,755 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62523 dest: /127.0.0.1:60693
2015-03-13 10:10:19,757 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62524 dest: /127.0.0.1:60696
2015-03-13 10:10:19,758 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242 src: /127.0.0.1:62525 dest: /127.0.0.1:60686
2015-03-13 10:10:19,761 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62525, dest: /127.0.0.1:60686, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 1760000
2015-03-13 10:10:19,762 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,762 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62524, dest: /127.0.0.1:60696, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 2446000
2015-03-13 10:10:19,762 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,763 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62523, dest: /127.0.0.1:60693, bytes: 53330, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, duration: 3177000
2015-03-13 10:10:19,763 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,764 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742066_1242{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:19,765 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml dst=null perm=null
2015-03-13 10:10:19,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:19,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml dst=null perm=null
2015-03-13 10:10:19,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:19,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020/job_1426266260362_0020_1_conf.xml dst=null perm=null
2015-03-13 10:10:19,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:19,777 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62522, bytes: 91691, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742059_1235, duration: 258000
2015-03-13 10:10:19,779 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:19,781 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62526 dest: /127.0.0.1:60696
2015-03-13 10:10:19,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62527 dest: /127.0.0.1:60686
2015-03-13 10:10:19,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243 src: /127.0.0.1:62528 dest: /127.0.0.1:60693
2015-03-13 10:10:19,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62528, dest: /127.0.0.1:60693, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 2191000
2015-03-13 10:10:19,787 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:19,787 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62527, dest: /127.0.0.1:60686, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 2895000
2015-03-13 10:10:19,788 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,788 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62526, dest: /127.0.0.1:60696, bytes: 90979, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2134179526_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, duration: 3616000
2015-03-13 10:10:19,789 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:19,789 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742067_1243{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:19,790 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2134179526_1
2015-03-13 10:10:19,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:19,804 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:19,804 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0020
2015-03-13 10:10:19,804 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from RUNNING to REMOVING
2015-03-13 10:10:19,804 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0020
2015-03-13 10:10:19,805 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from REMOVING to FINISHING
2015-03-13 10:10:20,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:20,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:20,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000006
2015-03-13 10:10:20,354 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:20,354 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:20,354 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000006
2015-03-13 10:10:20,354 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:20,354 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:20,355 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,355 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,355 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:20,355 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:20,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:20,640 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000002
2015-03-13 10:10:20,641 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:20,641 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:20,641 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000002
2015-03-13 10:10:20,641 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:20,641 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:20,642 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,642 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:20,642 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:20,642 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000002 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:20,814 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742055_1231 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:10:20,814 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742056_1232 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:10:20,814 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742057_1233 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:10:20,814 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742058_1234 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:10:20,815 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742062_1238 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:10:20,815 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742059_1235 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:10:20,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0020 dst=null perm=null
2015-03-13 10:10:20,856 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,857 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary
2015-03-13 10:10:20,857 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/_temporary dst=null perm=null
2015-03-13 10:10:20,864 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,865 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:20,866 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:20,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,869 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:20,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2015-03-13 10:10:20,872 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 189000
2015-03-13 10:10:20,873 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2015-03-13 10:10:20,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 166000
2015-03-13 10:10:20,875 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2015-03-13 10:10:20,876 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 156000
2015-03-13 10:10:20,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2015-03-13 10:10:20,879 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 184000
2015-03-13 10:10:20,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2015-03-13 10:10:20,886 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:20,887 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:20,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,890 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:20,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2015-03-13 10:10:20,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 167000
2015-03-13 10:10:20,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2015-03-13 10:10:20,893 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 156000
2015-03-13 10:10:20,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2015-03-13 10:10:20,895 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 142000
2015-03-13 10:10:20,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2015-03-13 10:10:20,897 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 166000
2015-03-13 10:10:20,898 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2015-03-13 10:10:20,898 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost
2015-03-13 10:10:20,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,899 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,900 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost dst=null perm=null
2015-03-13 10:10:20,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2015-03-13 10:10:20,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00000 dst=null perm=null
2015-03-13 10:10:20,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240, duration: 113000
2015-03-13 10:10:20,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2015-03-13 10:10:20,904 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00001 dst=null perm=null
2015-03-13 10:10:20,905 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62530, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237, duration: 114000
2015-03-13 10:10:20,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2015-03-13 10:10:20,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00002 dst=null perm=null
2015-03-13 10:10:20,908 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236, duration: 170000
2015-03-13 10:10:20,908 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2015-03-13 10:10:20,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00003 dst=null perm=null
2015-03-13 10:10:20,910 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62532, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239, duration: 166000
2015-03-13 10:10:20,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2015-03-13 10:10:20,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinrightmost/part-00004 dst=null perm=null
2015-03-13 10:10:20,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:20,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:20,924 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:20,925 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:20,925 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:20,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:20,934 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:10:20,934 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:10:20,935 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:20,935 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone"]
2015-03-13 10:10:20,935 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:10:20,935 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:10:20,935 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:10:20,936 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...dedpipesplatform/joinnone
2015-03-13 10:10:20,942 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:20,949 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:20,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:20,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:20,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:20,954 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 21
2015-03-13 10:10:20,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=null
2015-03-13 10:10:20,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:20,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:10:20,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:20,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,960 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:20,962 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62535 dest: /127.0.0.1:60693
2015-03-13 10:10:20,963 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62536 dest: /127.0.0.1:60696
2015-03-13 10:10:20,964 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62537 dest: /127.0.0.1:60686
2015-03-13 10:10:20,968 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62537, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 1936000
2015-03-13 10:10:20,968 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:20,968 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,968 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62536, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 2586000
2015-03-13 10:10:20,968 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,969 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,969 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62535, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 3599000
2015-03-13 10:10:20,969 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,970 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742068_1244{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,971 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:20,972 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar
2015-03-13 10:10:20,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:20,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:20,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:20,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:20,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:10:20,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:10:20,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:10:20,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:10:20,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:10:20,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:20,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:20,981 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:20,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:20,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:20,986 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split
2015-03-13 10:10:20,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:20,987 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:20,988 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62538 dest: /127.0.0.1:60696
2015-03-13 10:10:20,989 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62539 dest: /127.0.0.1:60689
2015-03-13 10:10:20,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62540 dest: /127.0.0.1:60693
2015-03-13 10:10:20,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245 src: /127.0.0.1:62541 dest: /127.0.0.1:60686
2015-03-13 10:10:20,995 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62541, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 1590000
2015-03-13 10:10:20,995 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:20,995 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,995 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62540, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 1799000
2015-03-13 10:10:20,996 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,996 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,996 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62539, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 2762000
2015-03-13 10:10:20,996 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,997 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,997 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62538, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 3731000
2015-03-13 10:10:20,997 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:20,998 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742069_1245{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:20,999 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,002 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:21,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62542 dest: /127.0.0.1:60686
2015-03-13 10:10:21,005 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62543 dest: /127.0.0.1:60693
2015-03-13 10:10:21,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246 src: /127.0.0.1:62544 dest: /127.0.0.1:60696
2015-03-13 10:10:21,009 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62544, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 1135000
2015-03-13 10:10:21,009 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:21,010 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,010 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62543, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 1754000
2015-03-13 10:10:21,010 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,011 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62542, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 2736000
2015-03-13 10:10:21,011 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,015 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742070_1246{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:21,016 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,016 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:21,017 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:21,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:21,020 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:21,021 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:21,025 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:21,027 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62545 dest: /127.0.0.1:60689
2015-03-13 10:10:21,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:21,028 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62546 dest: /127.0.0.1:60693
2015-03-13 10:10:21,030 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247 src: /127.0.0.1:62547 dest: /127.0.0.1:60686
2015-03-13 10:10:21,032 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62547, dest: /127.0.0.1:60686, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 1534000
2015-03-13 10:10:21,033 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:21,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,033 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62546, dest: /127.0.0.1:60693, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 1964000
2015-03-13 10:10:21,033 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,034 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,034 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62545, dest: /127.0.0.1:60689, bytes: 97640, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 2831000
2015-03-13 10:10:21,034 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:21,035 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742071_1247{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:21,036 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:21,036 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0021
2015-03-13 10:10:21,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=null
2015-03-13 10:10:21,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:21,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:21,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:21,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:21,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:21,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:21,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:21,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:21,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:21,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:21,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:21,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:21,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:21,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:21,046 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 21 submitted by user soberoi
2015-03-13 10:10:21,046 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0021
2015-03-13 10:10:21,046 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0021
2015-03-13 10:10:21,046 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0021
2015-03-13 10:10:21,046 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from NEW to NEW_SAVING
2015-03-13 10:10:21,047 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:21,047 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,047 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:21,047 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0021 from user: soberoi activated in queue: default
2015-03-13 10:10:21,047 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0021 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:21,047 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0021 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:21,047 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0021 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:21,047 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0021_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:21,048 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:21,048 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:21,050 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0021/
2015-03-13 10:10:21,050 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0021
2015-03-13 10:10:21,050 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0021/
2015-03-13 10:10:21,357 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:21,358 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:21,358 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:21,358 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0021_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:21,358 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:21,358 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:21,358 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:21,359 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0021 AttemptId: appattempt_1426266260362_0021_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:10:21,360 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:21,360 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,360 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:21,360 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0021_000001
2015-03-13 10:10:21,361 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,361 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0021_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:10:21,363 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:21,364 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000001 by user soberoi
2015-03-13 10:10:21,364 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:21,365 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:21,365 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:21,365 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000001 to application application_1426266260362_0021
2015-03-13 10:10:21,365 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:21,365 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0021_000001
2015-03-13 10:10:21,365 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:21,365 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:21,365 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:21,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:21,366 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000001
2015-03-13 10:10:21,376 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0021_01_000001.tokens. Credentials list:
2015-03-13 10:10:21,391 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:21,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0021_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001.tokens
2015-03-13 10:10:21,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:21,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:21,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:21,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:21,536 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 509000
2015-03-13 10:10:21,554 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:21,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:21,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:21,579 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62531, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 155000
2015-03-13 10:10:21,591 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:21,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:21,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:21,616 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 170000
2015-03-13 10:10:21,628 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:21,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:21,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:21,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62533, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1557208892_11054, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 330000
2015-03-13 10:10:21,665 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:21,665 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:21,693 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:21,693 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:21,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001/default_container_executor.sh]
2015-03-13 10:10:21,948 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742068_1244 to datanode(s) 127.0.0.1:60689
2015-03-13 10:10:21,948 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742058_1234, blk_1073742059_1235, blk_1073742062_1238]
2015-03-13 10:10:21,948 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742058_1234, blk_1073742062_1238]
2015-03-13 10:10:22,034 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:22,357 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:22,358 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:22,554 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 to 127.0.0.1:60689
2015-03-13 10:10:22,556 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:10:22,556 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62551 dest: /127.0.0.1:60689
2015-03-13 10:10:22,558 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244 src: /127.0.0.1:62551 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:10:22,559 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742068_1244 size 254067
2015-03-13 10:10:22,750 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:22,750 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:22,750 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:22,750 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:22,750 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:22,751 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:22,751 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:22,751 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:22,751 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:22,752 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:22,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:22,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:22,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:22,927 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:22,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:22,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:22,928 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:22,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:22,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:22,929 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:23,039 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:23,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:23,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED dst=null perm=null
2015-03-13 10:10:23,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:10:23,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_FAIL dst=null perm=null
2015-03-13 10:10:23,362 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:23,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=null
2015-03-13 10:10:23,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:10:23,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:10:23,457 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:23,458 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:23,459 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:23,459 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:23,460 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:23,460 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:23,460 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:23,661 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:23,661 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:23,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:23,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:23,662 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:23,664 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:23,682 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:23,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:23,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62553, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246, duration: 126000
2015-03-13 10:10:23,859 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:23,859 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:23,864 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742062_1238
2015-03-13 10:10:23,864 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:23,864 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:24,015 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742060_1236
2015-03-13 10:10:24,017 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:24,017 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:24,018 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742064_1240
2015-03-13 10:10:24,018 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:24,018 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742061_1237
2015-03-13 10:10:24,042 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:24,221 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247
2015-03-13 10:10:24,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:24,222 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:24,363 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:24,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:24,504 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:24,506 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0021_000001
2015-03-13 10:10:24,506 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0021 APPATTEMPTID=appattempt_1426266260362_0021_000001
2015-03-13 10:10:24,506 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:24,506 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from ACCEPTED to RUNNING
2015-03-13 10:10:24,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:24,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:24,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:24,617 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244
2015-03-13 10:10:24,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742063_1239
2015-03-13 10:10:24,619 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742067_1243
2015-03-13 10:10:24,619 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245
2015-03-13 10:10:24,619 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742070_1246
2015-03-13 10:10:24,619 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241
2015-03-13 10:10:24,620 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742066_1242
2015-03-13 10:10:24,715 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:24,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62559 dest: /127.0.0.1:60686
2015-03-13 10:10:24,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62560 dest: /127.0.0.1:60693
2015-03-13 10:10:24,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248 src: /127.0.0.1:62561 dest: /127.0.0.1:60689
2015-03-13 10:10:24,761 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62561, dest: /127.0.0.1:60689, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 6140000
2015-03-13 10:10:24,761 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:24,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,762 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62560, dest: /127.0.0.1:60693, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 6704000
2015-03-13 10:10:24,762 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:24,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,763 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62559, dest: /127.0.0.1:60686, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 7656000
2015-03-13 10:10:24,763 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742072_1248{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:24,763 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:24,767 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:24,953 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742059_1235]
2015-03-13 10:10:24,953 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742055_1231, blk_1073742056_1232, blk_1073742057_1233, blk_1073742058_1234, blk_1073742059_1235, blk_1073742062_1238]
2015-03-13 10:10:25,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:25,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:25,554 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058 for deletion
2015-03-13 10:10:25,555 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:25,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:25,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062 for deletion
2015-03-13 10:10:25,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742058_1234 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742058
2015-03-13 10:10:25,556 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:25,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742062_1238 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742062
2015-03-13 10:10:25,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055 for deletion
2015-03-13 10:10:25,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056 for deletion
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742055_1231 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742055
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057 for deletion
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059 for deletion
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742056_1232 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742056
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742057_1233 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742057
2015-03-13 10:10:25,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742059_1235 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742059
2015-03-13 10:10:25,654 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,655 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:25,655 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:25,655 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,655 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:25,655 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,656 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,656 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:25,656 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:25,656 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:25,657 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,657 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:25,657 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:25,657 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,657 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:25,658 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,658 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:25,658 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:25,658 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:25,658 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0021_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,658 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:25,658 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:25,949 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0020_01_000001 succeeded
2015-03-13 10:10:25,949 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:25,949 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:25,957 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:25,958 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0020_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:25,958 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0020_01_000001 from application application_1426266260362_0020
2015-03-13 10:10:25,958 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:25,959 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0020
2015-03-13 10:10:25,957 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0020/container_1426266260362_0020_01_000001
2015-03-13 10:10:26,049 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 20 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:26,049 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0020_01_000001
2015-03-13 10:10:26,050 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0020_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:26,050 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0020_000001
2015-03-13 10:10:26,050 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0020_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:26,050 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0020 CONTAINERID=container_1426266260362_0020_01_000001
2015-03-13 10:10:26,050 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0020_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:26,051 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0020_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:26,051 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0020 State change from FINISHING to FINISHED
2015-03-13 10:10:26,051 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:26,051 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0020_000001
2015-03-13 10:10:26,051 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0020_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,051 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0020
2015-03-13 10:10:26,051 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,052 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0020,name=[E6523EE1541F4C2199F3EC42AB5499B5/0A2AB8927DF243BD907C69BD6B859EF6] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0020/jobhistory/job/job_1426266260362_0020,appMasterHost=Edinburgh.local,startTime=1426266604533,finishTime=1426266619805,finalStatus=SUCCEEDED
2015-03-13 10:10:26,052 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:10:26,052 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0020_000001 released container container_1426266260362_0020_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:26,053 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:26,053 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:26,053 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:26,053 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0021 container=Container: [ContainerId: container_1426266260362_0021_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0021_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,053 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:26,053 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:26,053 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0020_000001 is done. finalState=FINISHED
2015-03-13 10:10:26,054 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0020 requests cleared
2015-03-13 10:10:26,054 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0020 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:26,054 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0020 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:26,054 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0020_000001 (auth:SIMPLE)
2015-03-13 10:10:26,055 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0020_01_000001
2015-03-13 10:10:26,369 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:26,369 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:26,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,370 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:26,371 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:26,371 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:26,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,543 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:26,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:26,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:26,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:26,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:26,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:26,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:26,655 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:26,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,655 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:26,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,655 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:26,655 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:26,655 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,656 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:26,669 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:26,669 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:26,673 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000006 by user soberoi
2015-03-13 10:10:26,673 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:26,673 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:26,673 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:26,673 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000006 to application application_1426266260362_0021
2015-03-13 10:10:26,674 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:26,674 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000005 by user soberoi
2015-03-13 10:10:26,674 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0021
2015-03-13 10:10:26,674 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:26,675 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000003 by user soberoi
2015-03-13 10:10:26,675 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from NEW to INITING
2015-03-13 10:10:26,674 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,675 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,675 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,675 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,675 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,675 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,675 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,676 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000006
2015-03-13 10:10:26,675 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000005 to application application_1426266260362_0021
2015-03-13 10:10:26,676 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000003 to application application_1426266260362_0021
2015-03-13 10:10:26,676 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from INITING to RUNNING
2015-03-13 10:10:26,676 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,677 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,677 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,677 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,677 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,677 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,677 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,678 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000005
2015-03-13 10:10:26,675 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:26,675 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000002 by user soberoi
2015-03-13 10:10:26,678 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000003
2015-03-13 10:10:26,678 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:26,679 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000002 to application application_1426266260362_0021
2015-03-13 10:10:26,679 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,679 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,679 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,679 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,679 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,679 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000002
2015-03-13 10:10:26,682 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0021_01_000004 by user soberoi
2015-03-13 10:10:26,682 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:26,682 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0021_01_000004 to application application_1426266260362_0021
2015-03-13 10:10:26,683 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:26,683 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,683 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0021
2015-03-13 10:10:26,683 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:26,683 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0021
2015-03-13 10:10:26,683 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0021_01_000004
2015-03-13 10:10:26,696 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0021_01_000006.tokens. Credentials list:
2015-03-13 10:10:26,699 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000003.tokens. Credentials list:
2015-03-13 10:10:26,699 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000005.tokens. Credentials list:
2015-03-13 10:10:26,700 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000002.tokens. Credentials list:
2015-03-13 10:10:26,701 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000004.tokens. Credentials list:
2015-03-13 10:10:26,703 INFO hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:10:26,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:10:26,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:10:26,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary dst=null perm=null
2015-03-13 10:10:26,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary dst=null perm=null
2015-03-13 10:10:26,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary dst=null perm=null
2015-03-13 10:10:26,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 458, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741969_1145, duration: 156000
2015-03-13 10:10:26,710 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0012,submitTime=1426266462037,launchTime=1426266465337,firstMapTaskLaunchTime=1426266467501,firstReduceTaskLaunchTime=1426266479436,finishTime=1426266482378,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotSeconds=2,jobName=[65C1F8B7B9BE47B0A23DAB67E3AF740D/2BC7D8F0414F4AAC967872FE1A0F4420] cogrouping/(1/2) ...tform/joinsintocogrouprhs
2015-03-13 10:10:26,711 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary]
2015-03-13 10:10:26,711 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62565, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741982_1158, duration: 210000
2015-03-13 10:10:26,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 414, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741959_1135, duration: 120000
2015-03-13 10:10:26,712 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0013,submitTime=1426266483799,launchTime=1426266487399,firstMapTaskLaunchTime=1426266489591,firstReduceTaskLaunchTime=0,finishTime=1426266500368,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=50,reduceSlotSeconds=0,jobName=[66292338870B4E96BCA2C279F2316D18/1DA395B3D9054135BCD4DF3C5499AF7E] lower*upper/(1/1) ...dpipesplatform/joinhasher
2015-03-13 10:10:26,712 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0011,submitTime=1426266445118,launchTime=1426266448756,firstMapTaskLaunchTime=1426266450919,firstReduceTaskLaunchTime=0,finishTime=1426266460776,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[65C1F8B7B9BE47B0A23DAB67E3AF740D/3CA34A330FF64917AFF7341793394779] cogrouping/(2/2)
2015-03-13 10:10:26,712 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary]
2015-03-13 10:10:26,712 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741969_1145 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:10:26,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012.summary dst=null perm=null
2015-03-13 10:10:26,712 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary]
2015-03-13 10:10:26,714 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741959_1135 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:10:26,714 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741982_1158 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:10:26,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011.summary dst=null perm=null
2015-03-13 10:10:26,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013.summary dst=null perm=null
2015-03-13 10:10:26,716 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,718 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,718 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012-1426266462037-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F2BC7D8F0414F4AAC-1426266482378-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,719 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012_conf.xml
2015-03-13 10:10:26,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013-1426266483799-soberoi-%5B66292338870B4E96BCA2C279F2316D18%2F1DA395B3D9054135-1426266500368-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,720 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013_conf.xml
2015-03-13 10:10:26,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011-1426266445118-soberoi-%5B65C1F8B7B9BE47B0A23DAB67E3AF740D%2F3CA34A330FF64917-1426266460776-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0012_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0012_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,721 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011_conf.xml
2015-03-13 10:10:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary dst=null perm=null
2015-03-13 10:10:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0013_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0013_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0011_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0011_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary dst=null perm=null
2015-03-13 10:10:26,723 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 437, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741993_1169, duration: 153000
2015-03-13 10:10:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary dst=null perm=null
2015-03-13 10:10:26,724 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0014,submitTime=1426266501740,launchTime=1426266505521,firstMapTaskLaunchTime=1426266507674,firstReduceTaskLaunchTime=1426266519609,finishTime=1426266522144,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=2,jobName=[6DC799D3695A41EDB24861BDF4BA2FF4/561BA7C30D2E4E9290533DB9645A592A] lower*upper*joined/(2/2)
2015-03-13 10:10:26,724 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary]
2015-03-13 10:10:26,725 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 450, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742003_1179, duration: 121000
2015-03-13 10:10:26,725 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0015,submitTime=1426266523400,launchTime=1426266526617,firstMapTaskLaunchTime=1426266528752,firstReduceTaskLaunchTime=0,finishTime=1426266531660,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=1,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=2,reduceSlotSeconds=0,jobName=[6DC799D3695A41EDB24861BDF4BA2FF4/3066B2C3CE37414884C03F0C08B36832] lower*upper*joined/(1/2) ...splatform/joingroupbyjoin
2015-03-13 10:10:26,725 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary]
2015-03-13 10:10:26,725 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073741993_1169 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:10:26,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014.summary dst=null perm=null
2015-03-13 10:10:26,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62568, bytes: 440, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742016_1192, duration: 159000
2015-03-13 10:10:26,727 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0016,submitTime=1426266532975,launchTime=1426266536303,firstMapTaskLaunchTime=1426266538457,firstReduceTaskLaunchTime=0,finishTime=1426266546259,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=4,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=30,reduceSlotSeconds=0,jobName=[E7F6D5868D024899941007FA966EB2C9/DF3D800AAAC346239F59A15452AAF080] lhs*rhs/(1/1) ...ieldedpipesplatform/cross
2015-03-13 10:10:26,727 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary]
2015-03-13 10:10:26,727 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:26,728 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742003_1179 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:10:26,728 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:26,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015.summary dst=null perm=null
2015-03-13 10:10:26,729 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742016_1192 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:10:26,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016.summary dst=null perm=null
2015-03-13 10:10:26,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,731 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,731 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,733 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014-1426266501740-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F561BA7C30D2E4E92-1426266522144-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,734 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014_conf.xml
2015-03-13 10:10:26,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016-1426266532975-soberoi-%5BE7F6D5868D024899941007FA966EB2C9%2FDF3D800AAAC34623-1426266546259-4-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,735 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016_conf.xml
2015-03-13 10:10:26,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015-1426266523400-soberoi-%5B6DC799D3695A41EDB24861BDF4BA2FF4%2F3066B2C3CE374148-1426266531660-1-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,736 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015_conf.xml
2015-03-13 10:10:26,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0016_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0016_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0014_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0014_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary dst=null perm=null
2015-03-13 10:10:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0015_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0015_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary dst=null perm=null
2015-03-13 10:10:26,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary dst=null perm=null
2015-03-13 10:10:26,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62566, bytes: 455, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742039_1215, duration: 151000
2015-03-13 10:10:26,739 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0018,submitTime=1426266563882,launchTime=1426266567567,firstMapTaskLaunchTime=1426266569726,firstReduceTaskLaunchTime=1426266583684,finishTime=1426266586326,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=6,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=67,reduceSlotSeconds=2,jobName=[CD6FBC07BE1742EBBA4ED3E85D978DBA/D4DC90FFC72F4258815AC79ED379D06A] merging/(1/1) ...platform/joinsintogroupby
2015-03-13 10:10:26,739 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary]
2015-03-13 10:10:26,740 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742052_1228, duration: 113000
2015-03-13 10:10:26,740 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742029_1205, duration: 100000
2015-03-13 10:10:26,740 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0019,submitTime=1426266587640,launchTime=1426266591360,firstMapTaskLaunchTime=1426266593528,firstReduceTaskLaunchTime=0,finishTime=1426266603162,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B7ACEFEF0218423EB65E6E148EB627C7/2A3F31AD6A62450CB825E66F41825487] lower*upper/(1/1) ...ldedpipesplatform/unknown
2015-03-13 10:10:26,741 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary]
2015-03-13 10:10:26,741 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0017,submitTime=1426266547587,launchTime=1426266550919,firstMapTaskLaunchTime=1426266553099,firstReduceTaskLaunchTime=0,finishTime=1426266562540,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[E8F7ECEBD6AF435181C0FE297F64D1A5/DF54CDC6A1544804917CE472FDCAAAEE] lower*upper/(1/1) ...fieldedpipesplatform/join
2015-03-13 10:10:26,741 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary]
2015-03-13 10:10:26,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742039_1215 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:10:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018.summary dst=null perm=null
2015-03-13 10:10:26,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742052_1228 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:10:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019.summary dst=null perm=null
2015-03-13 10:10:26,742 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742029_1205 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:10:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017.summary dst=null perm=null
2015-03-13 10:10:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,746 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist
2015-03-13 10:10:26,746 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,746 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018-1426266563882-soberoi-%5BCD6FBC07BE1742EBBA4ED3E85D978DBA%2FD4DC90FFC72F4258-1426266586326-6-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018_conf.xml
2015-03-13 10:10:26,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017-1426266547587-soberoi-%5BE8F7ECEBD6AF435181C0FE297F64D1A5%2FDF54CDC6A1544804-1426266562540-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019-1426266587640-soberoi-%5BB7ACEFEF0218423EB65E6E148EB627C7%2F2A3F31AD6A62450C-1426266603162-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,748 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017_conf.xml
2015-03-13 10:10:26,748 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019_conf.xml
2015-03-13 10:10:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0018_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0018_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0019_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0019_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0017_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0017_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary dst=null perm=null
2015-03-13 10:10:26,752 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62568, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742065_1241, duration: 316000
2015-03-13 10:10:26,752 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0020,submitTime=1426266604533,launchTime=1426266608090,firstMapTaskLaunchTime=1426266610256,firstReduceTaskLaunchTime=0,finishTime=1426266619698,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[E6523EE1541F4C2199F3EC42AB5499B5/0A2AB8927DF243BD907C69BD6B859EF6] lower*upper1*upper2/(1/1) ...m/joinaroundjoinrightmost
2015-03-13 10:10:26,752 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary]
2015-03-13 10:10:26,753 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742065_1241 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:10:26,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020.summary dst=null perm=null
2015-03-13 10:10:26,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:10:26,758 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist
2015-03-13 10:10:26,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020-1426266604533-soberoi-%5BE6523EE1541F4C2199F3EC42AB5499B5%2F0A2AB8927DF243BD-1426266619698-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,759 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020_conf.xml
2015-03-13 10:10:26,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0020_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0020_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:26,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003.tokens
2015-03-13 10:10:26,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0021_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006.tokens
2015-03-13 10:10:26,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:26,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:26,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar dst=null perm=null
2015-03-13 10:10:26,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62565, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_508868064_11204, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 488000
2015-03-13 10:10:26,903 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1107203517_11205, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742068_1244, duration: 512000
2015-03-13 10:10:26,923 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,924 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,942 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml dst=null perm=null
2015-03-13 10:10:26,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62569, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_508868064_11204, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 267000
2015-03-13 10:10:26,950 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62567, bytes: 98404, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1107203517_11205, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742071_1247, duration: 283000
2015-03-13 10:10:26,965 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,965 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,965 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,966 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,965 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:26,966 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:26,966 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:27,010 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,011 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,011 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,011 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,022 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,023 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,023 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,023 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,028 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:27,028 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:27,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,057 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:27,057 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,057 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,057 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,057 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0020
2015-03-13 10:10:27,057 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0020 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:27,057 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0020, with delay of 10800 seconds
2015-03-13 10:10:27,057 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,058 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0020
2015-03-13 10:10:27,157 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004/default_container_executor.sh]
2015-03-13 10:10:27,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002/default_container_executor.sh]
2015-03-13 10:10:27,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006/default_container_executor.sh]
2015-03-13 10:10:27,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005/default_container_executor.sh]
2015-03-13 10:10:27,188 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003/default_container_executor.sh]
2015-03-13 10:10:27,370 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,557 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:10:27,655 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:27,656 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,656 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,657 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,657 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:27,954 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073742052_1228, blk_1073742039_1215, blk_1073741959_1135, blk_1073741993_1169]
2015-03-13 10:10:27,954 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073741969_1145, blk_1073742003_1179, blk_1073742039_1215, blk_1073741959_1135, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:27,993 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,058 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004.tokens
2015-03-13 10:10:28,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,217 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0021_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002.tokens
2015-03-13 10:10:28,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,373 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:28,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:28,557 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:28,558 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:28,559 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:28,595 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0021_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005.tokens
2015-03-13 10:10:28,596 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:28,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:28,759 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:28,760 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:28,868 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:28,869 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:29,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,419 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248
2015-03-13 10:10:29,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:29,658 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,379 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:30,958 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073741969_1145, blk_1073742003_1179, blk_1073742052_1228, blk_1073742039_1215, blk_1073741959_1135, blk_1073741993_1169, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:30,958 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742016_1192, blk_1073742065_1241, blk_1073741969_1145, blk_1073742003_1179, blk_1073742052_1228, blk_1073741993_1169, blk_1073742029_1205, blk_1073741982_1158]
2015-03-13 10:10:31,067 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,380 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:31,561 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:31,562 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:31,563 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:31,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,665 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,666 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016 for deletion
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969 for deletion
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065 for deletion
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003 for deletion
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742016_1192 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742016
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741969_1145 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741969
2015-03-13 10:10:31,933 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052 for deletion
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742003_1179 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742003
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742065_1241 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742065
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959 for deletion
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039 for deletion
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742052_1228 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742052
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993 for deletion
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029 for deletion
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741959_1135 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741959
2015-03-13 10:10:31,934 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982 for deletion
2015-03-13 10:10:31,935 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742039_1215 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742039
2015-03-13 10:10:31,935 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741993_1169 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741993
2015-03-13 10:10:31,935 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742029_1205 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742029
2015-03-13 10:10:31,935 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073741982_1158 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073741982
2015-03-13 10:10:32,072 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:32,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,074 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,387 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:33,674 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,079 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,388 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,679 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:34,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:35,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:35,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:35,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,106 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:35,152 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62586, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 170000
2015-03-13 10:10:35,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job.split dst=null perm=null
2015-03-13 10:10:35,235 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62589, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 171000
2015-03-13 10:10:35,242 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62588, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 161000
2015-03-13 10:10:35,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62590, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 174000
2015-03-13 10:10:35,308 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62591, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742069_1245, duration: 189000
2015-03-13 10:10:35,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:35,320 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62592, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 171000
2015-03-13 10:10:35,339 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2102 Total time for transactions(ms): 103 Number of transactions batched in Syncs: 5 Number of syncs: 1201 SyncTimes(ms): 341 263
2015-03-13 10:10:35,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:35,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:35,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:35,369 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62593, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 255000
2015-03-13 10:10:35,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62594, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 189000
2015-03-13 10:10:35,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:35,445 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62595, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:10:35,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:35,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,684 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,771 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62586, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:10:35,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,794 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0021_m_000004_0_-978846826_1
2015-03-13 10:10:35,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:10:35,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0 dst=null perm=null
2015-03-13 10:10:35,806 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62596, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:10:35,811 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0 dst=null perm=null
2015-03-13 10:10:35,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004 dst=null perm=null
2015-03-13 10:10:35,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:35,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,820 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62590, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 175000
2015-03-13 10:10:35,837 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:35,837 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000006
2015-03-13 10:10:35,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:35,851 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000006 is : 143
2015-03-13 10:10:35,851 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:35,854 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:35,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62598 dest: /127.0.0.1:60686
2015-03-13 10:10:35,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62599 dest: /127.0.0.1:60693
2015-03-13 10:10:35,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250 src: /127.0.0.1:62600 dest: /127.0.0.1:60696
2015-03-13 10:10:35,863 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:35,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,864 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000006
2015-03-13 10:10:35,863 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:35,864 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:35,864 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000006 from application application_1426266260362_0021
2015-03-13 10:10:35,864 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:35,865 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:35,865 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist for DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:35,869 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:35,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,910 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62597 dest: /127.0.0.1:60693
2015-03-13 10:10:35,911 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62602 dest: /127.0.0.1:60686
2015-03-13 10:10:35,912 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249 src: /127.0.0.1:62603 dest: /127.0.0.1:60696
2015-03-13 10:10:35,918 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62601 dest: /127.0.0.1:60696
2015-03-13 10:10:35,919 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62604 dest: /127.0.0.1:60693
2015-03-13 10:10:35,921 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251 src: /127.0.0.1:62605 dest: /127.0.0.1:60689
2015-03-13 10:10:35,923 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62603, dest: /127.0.0.1:60696, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 8791000
2015-03-13 10:10:35,923 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:35,923 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,924 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62602, dest: /127.0.0.1:60686, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 9399000
2015-03-13 10:10:35,924 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,924 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,924 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62597, dest: /127.0.0.1:60693, bytes: 80, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 10160000
2015-03-13 10:10:35,924 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,925 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742073_1249{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:35,931 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62605, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 8555000
2015-03-13 10:10:35,931 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:35,932 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,932 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62604, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 9389000
2015-03-13 10:10:35,932 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,932 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,933 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62601, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 10322000
2015-03-13 10:10:35,933 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:35,933 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742075_1251{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:35,937 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0021_m_000000_0_-1492391439_1
2015-03-13 10:10:35,943 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0021_m_000003_0_387821991_1
2015-03-13 10:10:35,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0 dst=null perm=null
2015-03-13 10:10:35,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:35,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0 dst=null perm=null
2015-03-13 10:10:35,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000 dst=null perm=null
2015-03-13 10:10:35,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:35,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62606, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 128000
2015-03-13 10:10:35,971 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000002
2015-03-13 10:10:35,971 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:35,971 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:35,972 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000002
2015-03-13 10:10:35,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:35,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:35,984 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000002 is : 143
2015-03-13 10:10:35,994 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:35,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000002
2015-03-13 10:10:35,996 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:35,996 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:35,997 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000002 from application application_1426266260362_0021
2015-03-13 10:10:35,997 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:35,997 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:35,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0 dst=null perm=null
2015-03-13 10:10:36,000 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0 dst=null perm=null
2015-03-13 10:10:36,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003 dst=null perm=null
2015-03-13 10:10:36,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,021 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000005
2015-03-13 10:10:36,021 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,021 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,022 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000005
2015-03-13 10:10:36,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000002
2015-03-13 10:10:36,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,023 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,023 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,023 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000002
2015-03-13 10:10:36,023 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:36,023 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:36,023 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,023 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:36,024 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000002 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:36,035 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000005 is : 143
2015-03-13 10:10:36,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62607 dest: /127.0.0.1:60696
2015-03-13 10:10:36,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62608 dest: /127.0.0.1:60693
2015-03-13 10:10:36,047 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,047 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252 src: /127.0.0.1:62609 dest: /127.0.0.1:60689
2015-03-13 10:10:36,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,049 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,050 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000005 from application application_1426266260362_0021
2015-03-13 10:10:36,050 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,050 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:36,056 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62609, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 6850000
2015-03-13 10:10:36,056 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,056 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,057 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62608, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 7302000
2015-03-13 10:10:36,057 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,057 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,057 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62607, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 8271000
2015-03-13 10:10:36,057 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,058 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742076_1252{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,062 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0021_m_000001_0_237217636_1
2015-03-13 10:10:36,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:36,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:10:36,070 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62610, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 173000
2015-03-13 10:10:36,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0 dst=null perm=null
2015-03-13 10:10:36,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0 dst=null perm=null
2015-03-13 10:10:36,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001 dst=null perm=null
2015-03-13 10:10:36,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,092 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000003
2015-03-13 10:10:36,092 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,093 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000003
2015-03-13 10:10:36,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000005
2015-03-13 10:10:36,094 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,094 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,094 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000005
2015-03-13 10:10:36,094 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:36,094 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:36,094 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,094 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,094 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:36,095 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:36,095 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:36,106 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000003 is : 143
2015-03-13 10:10:36,120 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,125 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,126 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,126 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000003 from application application_1426266260362_0021
2015-03-13 10:10:36,126 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,126 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,153 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62611 dest: /127.0.0.1:60689
2015-03-13 10:10:36,155 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62612 dest: /127.0.0.1:60693
2015-03-13 10:10:36,156 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253 src: /127.0.0.1:62613 dest: /127.0.0.1:60696
2015-03-13 10:10:36,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62613, dest: /127.0.0.1:60696, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 6494000
2015-03-13 10:10:36,164 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,165 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62612, dest: /127.0.0.1:60693, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 7448000
2015-03-13 10:10:36,165 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,166 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62611, dest: /127.0.0.1:60689, bytes: 40, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 8505000
2015-03-13 10:10:36,166 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,167 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742077_1253{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,171 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0021_m_000002_0_-2026454953_1
2015-03-13 10:10:36,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0 dst=null perm=null
2015-03-13 10:10:36,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0 dst=null perm=null
2015-03-13 10:10:36,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002 dst=null perm=null
2015-03-13 10:10:36,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/_temporary/attempt_1426266260362_0021_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:36,205 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000004
2015-03-13 10:10:36,205 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:36,205 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:36,205 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,206 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000003
2015-03-13 10:10:36,205 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000004
2015-03-13 10:10:36,206 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:36,206 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,206 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,206 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000003
2015-03-13 10:10:36,206 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:36,207 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:36,207 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,207 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,207 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:36,207 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000003 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:36,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,211 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1 dst=null perm=null
2015-03-13 10:10:36,219 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0021_01_000004 is : 143
2015-03-13 10:10:36,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000 dst=null perm=null
2015-03-13 10:10:36,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2015-03-13 10:10:36,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,231 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:36,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,231 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,232 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:36,232 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:36,232 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000004 from application application_1426266260362_0021
2015-03-13 10:10:36,233 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,233 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:36,233 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:36,234 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001 dst=null perm=null
2015-03-13 10:10:36,235 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2015-03-13 10:10:36,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002 dst=null perm=null
2015-03-13 10:10:36,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2015-03-13 10:10:36,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,250 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003 dst=null perm=null
2015-03-13 10:10:36,253 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2015-03-13 10:10:36,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:36,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004 dst=null perm=null
2015-03-13 10:10:36,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2015-03-13 10:10:36,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary/1/task_1426266260362_0021_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary dst=null perm=null
2015-03-13 10:10:36,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,272 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,275 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,288 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62600, dest: /127.0.0.1:60696, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 425881000
2015-03-13 10:10:36,288 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,289 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,289 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62599, dest: /127.0.0.1:60693, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 426885000
2015-03-13 10:10:36,289 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,290 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742074_1250{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:36,291 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62598, dest: /127.0.0.1:60686, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 428444000
2015-03-13 10:10:36,291 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,294 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742074_1250 size 53335
2015-03-13 10:10:36,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,298 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62614 dest: /127.0.0.1:60693
2015-03-13 10:10:36,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62615 dest: /127.0.0.1:60696
2015-03-13 10:10:36,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254 src: /127.0.0.1:62616 dest: /127.0.0.1:60689
2015-03-13 10:10:36,305 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62616, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 1483000
2015-03-13 10:10:36,305 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,306 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,306 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62615, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 2029000
2015-03-13 10:10:36,306 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,307 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62614, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 2950000
2015-03-13 10:10:36,307 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742078_1254{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,309 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist dst=null perm=null
2015-03-13 10:10:36,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:36,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist dst=null perm=null
2015-03-13 10:10:36,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:36,326 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1.jhist dst=null perm=null
2015-03-13 10:10:36,329 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62617, bytes: 53755, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250, duration: 169000
2015-03-13 10:10:36,332 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,334 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62618 dest: /127.0.0.1:60693
2015-03-13 10:10:36,335 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62619 dest: /127.0.0.1:60696
2015-03-13 10:10:36,337 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255 src: /127.0.0.1:62620 dest: /127.0.0.1:60689
2015-03-13 10:10:36,339 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62620, dest: /127.0.0.1:60689, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 1518000
2015-03-13 10:10:36,340 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,340 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62619, dest: /127.0.0.1:60696, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 1814000
2015-03-13 10:10:36,340 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,341 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,341 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62618, dest: /127.0.0.1:60693, bytes: 53335, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, duration: 2671000
2015-03-13 10:10:36,341 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,340 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,342 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742079_1255{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,344 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml dst=null perm=null
2015-03-13 10:10:36,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:36,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml dst=null perm=null
2015-03-13 10:10:36,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:36,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021/job_1426266260362_0021_1_conf.xml dst=null perm=null
2015-03-13 10:10:36,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:36,353 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62621, bytes: 91160, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742072_1248, duration: 229000
2015-03-13 10:10:36,355 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:36,357 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62622 dest: /127.0.0.1:60693
2015-03-13 10:10:36,358 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62623 dest: /127.0.0.1:60696
2015-03-13 10:10:36,360 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256 src: /127.0.0.1:62624 dest: /127.0.0.1:60689
2015-03-13 10:10:36,363 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62624, dest: /127.0.0.1:60689, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 2297000
2015-03-13 10:10:36,364 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:36,364 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,364 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62623, dest: /127.0.0.1:60696, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 2649000
2015-03-13 10:10:36,364 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,365 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,365 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62622, dest: /127.0.0.1:60693, bytes: 90452, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-2029422546_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, duration: 3720000
2015-03-13 10:10:36,365 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:36,366 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742080_1256{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:36,367 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-2029422546_1
2015-03-13 10:10:36,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:36,382 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:36,382 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0021
2015-03-13 10:10:36,382 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from RUNNING to REMOVING
2015-03-13 10:10:36,382 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0021
2015-03-13 10:10:36,382 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from REMOVING to FINISHING
2015-03-13 10:10:36,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:36,839 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:36,839 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000006
2015-03-13 10:10:36,840 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:36,840 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:36,840 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000006
2015-03-13 10:10:36,840 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:36,840 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:36,840 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,840 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:36,840 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:36,841 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:37,209 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:37,210 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000004
2015-03-13 10:10:37,210 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:37,211 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:37,211 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000004
2015-03-13 10:10:37,211 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:37,211 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:37,211 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,211 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,212 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:37,212 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000004 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:37,388 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742068_1244 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:10:37,388 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742069_1245 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:10:37,388 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742070_1246 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:10:37,388 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742071_1247 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:10:37,388 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742074_1250 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:10:37,389 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742072_1248 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:10:37,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0021 dst=null perm=null
2015-03-13 10:10:37,395 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:37,421 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,422 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary
2015-03-13 10:10:37,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/_temporary dst=null perm=null
2015-03-13 10:10:37,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,429 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,433 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:37,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2015-03-13 10:10:37,435 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62626, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 146000
2015-03-13 10:10:37,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2015-03-13 10:10:37,437 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 150000
2015-03-13 10:10:37,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2015-03-13 10:10:37,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 161000
2015-03-13 10:10:37,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2015-03-13 10:10:37,442 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 148000
2015-03-13 10:10:37,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2015-03-13 10:10:37,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,449 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,450 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,453 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:10:37,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2015-03-13 10:10:37,456 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62629, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 121000
2015-03-13 10:10:37,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2015-03-13 10:10:37,458 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 115000
2015-03-13 10:10:37,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2015-03-13 10:10:37,459 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 122000
2015-03-13 10:10:37,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2015-03-13 10:10:37,461 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 148000
2015-03-13 10:10:37,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2015-03-13 10:10:37,462 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinnone
2015-03-13 10:10:37,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone dst=null perm=null
2015-03-13 10:10:37,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2015-03-13 10:10:37,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00000 dst=null perm=null
2015-03-13 10:10:37,467 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 84, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249, duration: 169000
2015-03-13 10:10:37,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2015-03-13 10:10:37,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00001 dst=null perm=null
2015-03-13 10:10:37,476 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252, duration: 147000
2015-03-13 10:10:37,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2015-03-13 10:10:37,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00002 dst=null perm=null
2015-03-13 10:10:37,479 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253, duration: 172000
2015-03-13 10:10:37,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2015-03-13 10:10:37,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00003 dst=null perm=null
2015-03-13 10:10:37,481 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62628, bytes: 44, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251, duration: 175000
2015-03-13 10:10:37,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2015-03-13 10:10:37,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinnone/part-00004 dst=null perm=null
2015-03-13 10:10:37,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:37,493 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,494 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:10:37,494 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:10:37,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself"]
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 2
2015-03-13 10:10:37,509 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 2
2015-03-13 10:10:37,510 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/2)
2015-03-13 10:10:37,518 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,527 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:37,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:37,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:37,531 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 22
2015-03-13 10:10:37,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=null
2015-03-13 10:10:37,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:37,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:10:37,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:37,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,537 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:37,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62631 dest: /127.0.0.1:60693
2015-03-13 10:10:37,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62632 dest: /127.0.0.1:60696
2015-03-13 10:10:37,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62633 dest: /127.0.0.1:60689
2015-03-13 10:10:37,544 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62633, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 2722000
2015-03-13 10:10:37,544 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,544 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,544 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62632, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 2555000
2015-03-13 10:10:37,545 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,545 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,545 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62631, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 3378000
2015-03-13 10:10:37,545 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,546 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742081_1257{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,546 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,547 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar
2015-03-13 10:10:37,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:37,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:37,549 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:37,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:37,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:10:37,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:10:37,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:10:37,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:10:37,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:10:37,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:37,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:37,554 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:37,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:37,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,560 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split
2015-03-13 10:10:37,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:37,561 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:37,562 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62634 dest: /127.0.0.1:60696
2015-03-13 10:10:37,564 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62635 dest: /127.0.0.1:60686
2015-03-13 10:10:37,565 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62636 dest: /127.0.0.1:60689
2015-03-13 10:10:37,566 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258 src: /127.0.0.1:62637 dest: /127.0.0.1:60693
2015-03-13 10:10:37,569 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62637, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 1346000
2015-03-13 10:10:37,569 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,569 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,570 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62636, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 1799000
2015-03-13 10:10:37,570 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,570 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,570 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62635, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 2626000
2015-03-13 10:10:37,570 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,571 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,571 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62634, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 3480000
2015-03-13 10:10:37,571 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,571 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742082_1258{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,573 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,577 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:37,578 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62638 dest: /127.0.0.1:60696
2015-03-13 10:10:37,580 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62639 dest: /127.0.0.1:60686
2015-03-13 10:10:37,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259 src: /127.0.0.1:62640 dest: /127.0.0.1:60689
2015-03-13 10:10:37,583 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62640, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 1123000
2015-03-13 10:10:37,583 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,583 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,584 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62639, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 1594000
2015-03-13 10:10:37,584 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,584 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,584 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62638, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 2060000
2015-03-13 10:10:37,584 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,585 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742083_1259{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:37,586 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,586 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:37,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:37,589 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:37,589 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:37,590 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:37,593 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:37,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62641 dest: /127.0.0.1:60696
2015-03-13 10:10:37,595 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62642 dest: /127.0.0.1:60686
2015-03-13 10:10:37,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260 src: /127.0.0.1:62643 dest: /127.0.0.1:60693
2015-03-13 10:10:37,598 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62643, dest: /127.0.0.1:60693, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 1642000
2015-03-13 10:10:37,599 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:37,599 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,599 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62642, dest: /127.0.0.1:60686, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 2106000
2015-03-13 10:10:37,599 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,600 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,600 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62641, dest: /127.0.0.1:60696, bytes: 96425, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 2917000
2015-03-13 10:10:37,600 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:37,600 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742084_1260{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:37,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:37,601 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0022
2015-03-13 10:10:37,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=null
2015-03-13 10:10:37,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:37,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:37,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:37,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:37,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:37,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:37,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:37,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:37,609 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:37,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:37,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:37,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:37,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:37,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:37,614 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 22 submitted by user soberoi
2015-03-13 10:10:37,614 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0022
2015-03-13 10:10:37,615 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from NEW to NEW_SAVING
2015-03-13 10:10:37,615 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0022
2015-03-13 10:10:37,614 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0022
2015-03-13 10:10:37,615 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:37,615 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,615 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:37,615 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0022 from user: soberoi activated in queue: default
2015-03-13 10:10:37,615 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0022 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:37,616 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0022 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:37,616 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0022 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:37,616 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0022_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:37,616 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:37,617 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:37,618 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0022/
2015-03-13 10:10:37,619 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0022
2015-03-13 10:10:37,619 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0022/
2015-03-13 10:10:37,843 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:37,843 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:37,844 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:10:37,844 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0022_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,844 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:37,844 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:37,844 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:37,845 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0022 AttemptId: appattempt_1426266260362_0022_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:37,845 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:37,845 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:37,846 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,846 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0022_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:10:37,848 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:37,850 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000001 by user soberoi
2015-03-13 10:10:37,850 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:37,850 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:37,850 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:37,850 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000001 to application application_1426266260362_0022
2015-03-13 10:10:37,851 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:37,851 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0022_000001
2015-03-13 10:10:37,851 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:37,851 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:37,851 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:37,851 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,851 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,851 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,852 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:37,852 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000001
2015-03-13 10:10:37,861 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0022_01_000001.tokens. Credentials list:
2015-03-13 10:10:37,876 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:37,943 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0022_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001.tokens
2015-03-13 10:10:37,943 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:38,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:38,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:38,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:38,010 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 479000
2015-03-13 10:10:38,028 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:38,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:38,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:38,050 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62627, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 211000
2015-03-13 10:10:38,062 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:38,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:38,080 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:38,085 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62629, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 159000
2015-03-13 10:10:38,097 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:38,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:38,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:38,120 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62626, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-814663355_11605, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 269000
2015-03-13 10:10:38,132 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:38,133 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:38,157 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:38,157 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:38,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001/default_container_executor.sh]
2015-03-13 10:10:38,399 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:38,848 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:38,849 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:38,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:38,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:38,875 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:38,877 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:38,878 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:38,878 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,079 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,080 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,081 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:39,081 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,082 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,084 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:39,084 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:39,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:39,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:39,280 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,404 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:39,430 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,430 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,431 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:39,431 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,432 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:39,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254
2015-03-13 10:10:39,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742075_1251
2015-03-13 10:10:39,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742077_1253
2015-03-13 10:10:39,632 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259
2015-03-13 10:10:39,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258
2015-03-13 10:10:39,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742074_1250
2015-03-13 10:10:39,633 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742076_1252
2015-03-13 10:10:39,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:39,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED dst=null perm=null
2015-03-13 10:10:39,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:10:39,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_FAIL dst=null perm=null
2015-03-13 10:10:39,835 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:39,836 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742073_1249
2015-03-13 10:10:39,836 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742080_1256
2015-03-13 10:10:39,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=null
2015-03-13 10:10:39,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:10:39,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:10:39,849 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:39,962 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742081_1257 to datanode(s) 127.0.0.1:60686
2015-03-13 10:10:39,962 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742074_1250]
2015-03-13 10:10:39,962 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742074_1250]
2015-03-13 10:10:40,038 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742079_1255
2015-03-13 10:10:40,039 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260
2015-03-13 10:10:40,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:40,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:40,188 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62648, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742083_1259, duration: 125000
2015-03-13 10:10:40,409 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:40,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:40,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:40,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:40,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:40,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:40,566 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:40,764 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 to 127.0.0.1:60686
2015-03-13 10:10:40,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62651 dest: /127.0.0.1:60686
2015-03-13 10:10:40,765 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:10:40,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257 src: /127.0.0.1:62651 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:10:40,767 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742081_1257 size 254067
2015-03-13 10:10:40,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:40,939 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:40,939 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:40,939 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:40,940 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:40,940 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:40,940 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:40,940 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:40,940 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:40,983 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:40,985 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0022_000001
2015-03-13 10:10:40,985 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0022 APPATTEMPTID=appattempt_1426266260362_0022_000001
2015-03-13 10:10:40,985 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:40,985 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from ACCEPTED to RUNNING
2015-03-13 10:10:41,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:41,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:41,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:41,203 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:41,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62655 dest: /127.0.0.1:60693
2015-03-13 10:10:41,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62656 dest: /127.0.0.1:60696
2015-03-13 10:10:41,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261 src: /127.0.0.1:62657 dest: /127.0.0.1:60686
2015-03-13 10:10:41,260 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62657, dest: /127.0.0.1:60686, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 5486000
2015-03-13 10:10:41,260 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:41,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,261 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62656, dest: /127.0.0.1:60696, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 6155000
2015-03-13 10:10:41,261 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:41,261 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,261 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62655, dest: /127.0.0.1:60693, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 7145000
2015-03-13 10:10:41,262 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:41,262 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742085_1261{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:41,266 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:41,411 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:41,855 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,219 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,219 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:42,219 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:42,219 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,220 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:42,220 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,220 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:42,220 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:42,221 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,221 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:42,221 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,221 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,221 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:42,221 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:42,221 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:42,222 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,222 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:42,222 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:42,222 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0022_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,222 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:42,222 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,412 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,413 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:42,413 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:42,413 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0022_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:10:42,413 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0022 container=Container: [ContainerId: container_1426266260362_0022_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0022_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,414 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:42,414 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:42,526 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0021_01_000001 succeeded
2015-03-13 10:10:42,527 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:42,527 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0021_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:42,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,534 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0021_01_000001 from application application_1426266260362_0021
2015-03-13 10:10:42,534 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:42,534 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0021
2015-03-13 10:10:42,534 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021/container_1426266260362_0021_01_000001
2015-03-13 10:10:42,856 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:42,963 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742071_1247, blk_1073742072_1248]
2015-03-13 10:10:42,963 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742068_1244, blk_1073742069_1245, blk_1073742070_1246, blk_1073742071_1247, blk_1073742072_1248, blk_1073742074_1250]
2015-03-13 10:10:43,014 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,014 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,014 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,015 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,015 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:43,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:43,055 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:43,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:43,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:43,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:43,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:43,136 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:43,136 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:43,139 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000002 by user soberoi
2015-03-13 10:10:43,140 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000005 by user soberoi
2015-03-13 10:10:43,140 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:43,140 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000005 to application application_1426266260362_0022
2015-03-13 10:10:43,140 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000006 by user soberoi
2015-03-13 10:10:43,140 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:43,141 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:43,141 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000003 by user soberoi
2015-03-13 10:10:43,141 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0022
2015-03-13 10:10:43,141 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:43,141 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:43,141 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0022_01_000004 by user soberoi
2015-03-13 10:10:43,141 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:43,141 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000006 to application application_1426266260362_0022
2015-03-13 10:10:43,142 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:43,142 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,142 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,142 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,142 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,142 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,142 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,142 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,142 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000006
2015-03-13 10:10:43,141 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from NEW to INITING
2015-03-13 10:10:43,143 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000002 to application application_1426266260362_0022
2015-03-13 10:10:43,143 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000003 to application application_1426266260362_0022
2015-03-13 10:10:43,141 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:43,143 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0022_01_000004 to application application_1426266260362_0022
2015-03-13 10:10:43,143 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from INITING to RUNNING
2015-03-13 10:10:43,144 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:43,144 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,144 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,144 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,144 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,144 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,145 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,145 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,145 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,145 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,146 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,146 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0022
2015-03-13 10:10:43,146 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:43,146 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0022
2015-03-13 10:10:43,146 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000003
2015-03-13 10:10:43,147 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000004
2015-03-13 10:10:43,147 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000002
2015-03-13 10:10:43,150 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0022_01_000005
2015-03-13 10:10:43,159 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0022_01_000006.tokens. Credentials list:
2015-03-13 10:10:43,168 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000003.tokens. Credentials list:
2015-03-13 10:10:43,168 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0022_01_000002.tokens. Credentials list:
2015-03-13 10:10:43,168 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000004.tokens. Credentials list:
2015-03-13 10:10:43,169 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0022_01_000005.tokens. Credentials list:
2015-03-13 10:10:43,183 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:43,187 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:43,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,219 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,220 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,259 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0022_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006.tokens
2015-03-13 10:10:43,259 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:43,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003.tokens
2015-03-13 10:10:43,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:43,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,340 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar dst=null perm=null
2015-03-13 10:10:43,344 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62664, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1681704845_11748, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 414000
2015-03-13 10:10:43,348 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62665, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1786177933_11751, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257, duration: 424000
2015-03-13 10:10:43,366 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,371 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml dst=null perm=null
2015-03-13 10:10:43,397 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62666, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1681704845_11748, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 308000
2015-03-13 10:10:43,402 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62664, bytes: 97181, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1786177933_11751, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742084_1260, duration: 271000
2015-03-13 10:10:43,412 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,412 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,413 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 21 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:43,413 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0021_01_000001
2015-03-13 10:10:43,413 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,413 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:43,414 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0021_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:43,414 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0021_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:43,414 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0021 CONTAINERID=container_1426266260362_0021_01_000001
2015-03-13 10:10:43,414 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0021_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:43,414 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:43,414 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0021_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:43,414 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:43,414 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:43,414 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0021_000001 released container container_1426266260362_0021_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:43,414 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0021_000001
2015-03-13 10:10:43,415 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0021_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:43,415 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0021 State change from FINISHING to FINISHED
2015-03-13 10:10:43,415 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0021
2015-03-13 10:10:43,415 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0021,name=[5665C2AB3C80426983CDE9B8E87C8DA6/3A3A52572DE2469599E707FB097F70CF] lower*upper/(1/1) ...dedpipesplatform/joinnone,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0021/jobhistory/job/job_1426266260362_0021,appMasterHost=Edinburgh.local,startTime=1426266621046,finishTime=1426266636382,finalStatus=SUCCEEDED
2015-03-13 10:10:43,415 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0021_000001 is done. finalState=FINISHED
2015-03-13 10:10:43,415 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0021 requests cleared
2015-03-13 10:10:43,415 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0021 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:43,415 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0021 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:43,416 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0021_000001
2015-03-13 10:10:43,418 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0021_000001 (auth:SIMPLE)
2015-03-13 10:10:43,419 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:43,419 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:43,419 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0021_01_000001
2015-03-13 10:10:43,464 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,464 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,465 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,465 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,470 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,470 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,472 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,472 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,472 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:43,473 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:43,564 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:43,565 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:43,600 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004/default_container_executor.sh]
2015-03-13 10:10:43,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002/default_container_executor.sh]
2015-03-13 10:10:43,607 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006/default_container_executor.sh]
2015-03-13 10:10:43,620 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005/default_container_executor.sh]
2015-03-13 10:10:43,625 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003/default_container_executor.sh]
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742068_1244 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742068
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074 for deletion
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742069_1245 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742069
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742070_1246 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742070
2015-03-13 10:10:43,765 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742071_1247 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742071
2015-03-13 10:10:43,766 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742072_1248 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742072
2015-03-13 10:10:43,766 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742074_1250 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742074
2015-03-13 10:10:43,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:43,859 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:43,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:43,859 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:43,859 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:43,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:43,859 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,030 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:10:44,223 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,224 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:44,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:44,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,225 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:44,225 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:44,286 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:44,418 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,419 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:44,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,419 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,420 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0021
2015-03-13 10:10:44,420 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0021 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:44,421 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0021, with delay of 10800 seconds
2015-03-13 10:10:44,420 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0021
2015-03-13 10:10:44,435 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:44,437 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742081_1257
2015-03-13 10:10:44,450 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:44,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0022_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005.tokens
2015-03-13 10:10:44,583 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:44,685 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:44,806 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0022_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004.tokens
2015-03-13 10:10:44,807 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:44,860 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:44,923 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:45,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0022_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002.tokens
2015-03-13 10:10:45,044 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261
2015-03-13 10:10:45,044 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:45,229 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,229 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,229 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,230 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,422 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:45,863 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,230 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,231 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,423 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:46,865 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,236 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,428 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:47,869 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,238 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,238 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,239 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,239 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,432 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:48,870 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,244 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,244 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,245 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,245 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,434 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:49,874 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,248 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,249 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,437 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:50,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:51,252 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,252 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:51,424 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:51,441 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:51,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:51,483 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62677, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 169000
2015-03-13 10:10:51,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job.split dst=null perm=null
2015-03-13 10:10:51,584 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62682, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 157000
2015-03-13 10:10:51,595 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62683, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 172000
2015-03-13 10:10:51,615 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62684, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 149000
2015-03-13 10:10:51,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:51,645 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62686, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 185000
2015-03-13 10:10:51,675 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62685, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742082_1258, duration: 151000
2015-03-13 10:10:51,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:51,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62687, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 164000
2015-03-13 10:10:51,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:51,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62683, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 151000
2015-03-13 10:10:51,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:51,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:51,818 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62688, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:10:51,858 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:51,885 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,053 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:52,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62689 dest: /127.0.0.1:60686
2015-03-13 10:10:52,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62690 dest: /127.0.0.1:60689
2015-03-13 10:10:52,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262 src: /127.0.0.1:62691 dest: /127.0.0.1:60693
2015-03-13 10:10:52,106 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62691, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 5954000
2015-03-13 10:10:52,106 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,106 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,107 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62690, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 6771000
2015-03-13 10:10:52,107 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,107 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,107 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62689, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 7610000
2015-03-13 10:10:52,108 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,108 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742086_1262{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:52,112 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0022_m_000004_0_-271737584_1
2015-03-13 10:10:52,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0 dst=null perm=null
2015-03-13 10:10:52,128 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0 dst=null perm=null
2015-03-13 10:10:52,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004 dst=null perm=null
2015-03-13 10:10:52,133 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000004_0 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,158 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000006
2015-03-13 10:10:52,158 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:52,158 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,158 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000006
2015-03-13 10:10:52,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,171 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000006 is : 143
2015-03-13 10:10:52,172 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,174 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62694 dest: /127.0.0.1:60693
2015-03-13 10:10:52,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62695 dest: /127.0.0.1:60686
2015-03-13 10:10:52,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265 src: /127.0.0.1:62696 dest: /127.0.0.1:60696
2015-03-13 10:10:52,181 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist for DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,203 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62697, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 160000
2015-03-13 10:10:52,203 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000006
2015-03-13 10:10:52,204 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,205 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000006 from application application_1426266260362_0022
2015-03-13 10:10:52,205 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,205 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62693 dest: /127.0.0.1:60696
2015-03-13 10:10:52,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62698 dest: /127.0.0.1:60693
2015-03-13 10:10:52,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62692 dest: /127.0.0.1:60686
2015-03-13 10:10:52,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264 src: /127.0.0.1:62699 dest: /127.0.0.1:60689
2015-03-13 10:10:52,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62700 dest: /127.0.0.1:60696
2015-03-13 10:10:52,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263 src: /127.0.0.1:62701 dest: /127.0.0.1:60689
2015-03-13 10:10:52,224 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62701, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 6185000
2015-03-13 10:10:52,224 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,225 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,225 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62700, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 6795000
2015-03-13 10:10:52,225 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,225 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,225 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62692, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 7534000
2015-03-13 10:10:52,225 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742087_1263{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,233 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0022_m_000002_0_-875840111_1
2015-03-13 10:10:52,233 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62699, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 18553000
2015-03-13 10:10:52,234 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,234 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,235 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62698, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 19370000
2015-03-13 10:10:52,235 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,235 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62693, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 20266000
2015-03-13 10:10:52,236 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,236 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742088_1264{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,240 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,244 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0022_m_000003_0_1696893016_1
2015-03-13 10:10:52,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0 dst=null perm=null
2015-03-13 10:10:52,257 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,257 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0 dst=null perm=null
2015-03-13 10:10:52,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002 dst=null perm=null
2015-03-13 10:10:52,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000002_0 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0 dst=null perm=null
2015-03-13 10:10:52,279 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,279 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000004
2015-03-13 10:10:52,279 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,280 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,280 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,280 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62702 dest: /127.0.0.1:60693
2015-03-13 10:10:52,292 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000004 is : 143
2015-03-13 10:10:52,292 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62703 dest: /127.0.0.1:60689
2015-03-13 10:10:52,293 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266 src: /127.0.0.1:62704 dest: /127.0.0.1:60696
2015-03-13 10:10:52,302 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62704, dest: /127.0.0.1:60696, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 7080000
2015-03-13 10:10:52,302 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,303 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62703, dest: /127.0.0.1:60689, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 7922000
2015-03-13 10:10:52,303 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,303 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,304 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,304 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62702, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 8933000
2015-03-13 10:10:52,304 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,304 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,305 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000004 from application application_1426266260362_0022
2015-03-13 10:10:52,305 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,305 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000004
2015-03-13 10:10:52,305 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742090_1266{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,327 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0022_m_000000_0_-366512103_1
2015-03-13 10:10:52,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0 dst=null perm=null
2015-03-13 10:10:52,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003 dst=null perm=null
2015-03-13 10:10:52,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000003_0 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0 dst=null perm=null
2015-03-13 10:10:52,347 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000005
2015-03-13 10:10:52,347 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,348 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,348 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000005
2015-03-13 10:10:52,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000004
2015-03-13 10:10:52,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,349 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,349 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,349 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000004
2015-03-13 10:10:52,349 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:10:52,349 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:10:52,349 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,349 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,349 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:10:52,349 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:10:52,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0 dst=null perm=null
2015-03-13 10:10:52,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000 dst=null perm=null
2015-03-13 10:10:52,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000000_0 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,359 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000005 is : 143
2015-03-13 10:10:52,365 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000002
2015-03-13 10:10:52,366 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:52,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:10:52,372 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,372 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,373 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,374 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000005
2015-03-13 10:10:52,374 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000002
2015-03-13 10:10:52,385 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000002 is : 143
2015-03-13 10:10:52,386 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,394 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,394 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,394 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,395 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000005 from application application_1426266260362_0022
2015-03-13 10:10:52,395 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,395 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,395 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,396 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,396 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000002
2015-03-13 10:10:52,397 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,397 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000002 from application application_1426266260362_0022
2015-03-13 10:10:52,397 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,398 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,432 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62705 dest: /127.0.0.1:60696
2015-03-13 10:10:52,433 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62706 dest: /127.0.0.1:60686
2015-03-13 10:10:52,435 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267 src: /127.0.0.1:62707 dest: /127.0.0.1:60689
2015-03-13 10:10:52,443 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62707, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 6518000
2015-03-13 10:10:52,443 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,444 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,444 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62706, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 7196000
2015-03-13 10:10:52,444 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,444 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,444 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62705, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 7940000
2015-03-13 10:10:52,445 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,445 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742091_1267{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,450 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0022_m_000001_0_157658245_1
2015-03-13 10:10:52,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0 dst=null perm=null
2015-03-13 10:10:52,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0 dst=null perm=null
2015-03-13 10:10:52,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001 dst=null perm=null
2015-03-13 10:10:52,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/_temporary/attempt_1426266260362_0022_m_000001_0 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:52,488 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000003
2015-03-13 10:10:52,488 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:52,488 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:10:52,489 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000003
2015-03-13 10:10:52,489 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,489 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000002
2015-03-13 10:10:52,489 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:10:52,489 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:52,489 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000005
2015-03-13 10:10:52,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,490 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,490 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000002
2015-03-13 10:10:52,490 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:10:52,490 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:10:52,490 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,490 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,490 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:10:52,490 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000002 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:52,490 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:52,490 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:10:52,491 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000005
2015-03-13 10:10:52,491 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:10:52,491 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:10:52,491 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,491 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:52,491 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:10:52,491 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000005 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:10:52,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,495 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,499 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1 dst=null perm=null
2015-03-13 10:10:52,502 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0022_01_000003 is : 143
2015-03-13 10:10:52,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000 dst=null perm=null
2015-03-13 10:10:52,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:10:52,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000000/part-00000 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,515 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:10:52,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,516 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,516 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000003
2015-03-13 10:10:52,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001 dst=null perm=null
2015-03-13 10:10:52,518 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:52,518 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:10:52,518 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000003 from application application_1426266260362_0022
2015-03-13 10:10:52,518 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:52,519 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:52,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:10:52,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000001/part-00001 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002 dst=null perm=null
2015-03-13 10:10:52,525 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:10:52,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000002/part-00002 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003 dst=null perm=null
2015-03-13 10:10:52,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:10:52,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000003/part-00003 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:10:52,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004 dst=null perm=null
2015-03-13 10:10:52,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:10:52,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary/1/task_1426266260362_0022_m_000004/part-00004 dst=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_temporary dst=null perm=null
2015-03-13 10:10:52,542 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,544 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,549 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,563 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62696, dest: /127.0.0.1:60696, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 384760000
2015-03-13 10:10:52,563 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,564 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,564 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62695, dest: /127.0.0.1:60686, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 386140000
2015-03-13 10:10:52,564 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,566 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62694, dest: /127.0.0.1:60693, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 387646000
2015-03-13 10:10:52,566 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,566 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742089_1265{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,568 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,570 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,572 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:52,574 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62708 dest: /127.0.0.1:60693
2015-03-13 10:10:52,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62709 dest: /127.0.0.1:60689
2015-03-13 10:10:52,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268 src: /127.0.0.1:62710 dest: /127.0.0.1:60696
2015-03-13 10:10:52,579 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62710, dest: /127.0.0.1:60696, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 1377000
2015-03-13 10:10:52,580 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,580 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62709, dest: /127.0.0.1:60689, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 1846000
2015-03-13 10:10:52,580 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,581 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62708, dest: /127.0.0.1:60693, bytes: 411, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 2576000
2015-03-13 10:10:52,581 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742092_1268{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:52,583 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist dst=null perm=null
2015-03-13 10:10:52,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:52,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist dst=null perm=null
2015-03-13 10:10:52,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:10:52,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1.jhist dst=null perm=null
2015-03-13 10:10:52,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,604 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62711, bytes: 53733, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265, duration: 164000
2015-03-13 10:10:52,606 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,608 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62712 dest: /127.0.0.1:60696
2015-03-13 10:10:52,609 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62713 dest: /127.0.0.1:60686
2015-03-13 10:10:52,610 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269 src: /127.0.0.1:62714 dest: /127.0.0.1:60689
2015-03-13 10:10:52,613 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62714, dest: /127.0.0.1:60689, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 1530000
2015-03-13 10:10:52,613 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,614 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62713, dest: /127.0.0.1:60686, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 1988000
2015-03-13 10:10:52,614 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,614 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,615 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62712, dest: /127.0.0.1:60696, bytes: 53313, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, duration: 2983000
2015-03-13 10:10:52,615 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,616 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742093_1269{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,617 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742093_1269 size 53313
2015-03-13 10:10:52,617 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml dst=null perm=null
2015-03-13 10:10:52,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:52,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml dst=null perm=null
2015-03-13 10:10:52,624 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp dst=null perm=null
2015-03-13 10:10:52,625 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022/job_1426266260362_0022_1_conf.xml dst=null perm=null
2015-03-13 10:10:52,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:52,629 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62711, bytes: 90039, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742085_1261, duration: 259000
2015-03-13 10:10:52,631 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:52,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62715 dest: /127.0.0.1:60693
2015-03-13 10:10:52,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62716 dest: /127.0.0.1:60686
2015-03-13 10:10:52,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270 src: /127.0.0.1:62717 dest: /127.0.0.1:60689
2015-03-13 10:10:52,639 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62717, dest: /127.0.0.1:60689, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 2124000
2015-03-13 10:10:52,639 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:52,640 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62716, dest: /127.0.0.1:60686, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 2720000
2015-03-13 10:10:52,640 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,640 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,640 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62715, dest: /127.0.0.1:60693, bytes: 89339, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-504580455_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, duration: 3693000
2015-03-13 10:10:52,641 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:52,641 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,642 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742094_1270{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:52,643 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-504580455_1
2015-03-13 10:10:52,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,648 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,650 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:10:52,655 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from RUNNING to FINISHING
2015-03-13 10:10:52,655 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0022
2015-03-13 10:10:52,655 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from RUNNING to REMOVING
2015-03-13 10:10:52,655 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0022
2015-03-13 10:10:52,655 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from REMOVING to FINISHING
2015-03-13 10:10:52,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:53,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:53,159 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000006
2015-03-13 10:10:53,160 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:53,160 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:10:53,160 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000006
2015-03-13 10:10:53,160 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:53,160 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:10:53,161 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,161 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,161 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:10:53,161 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:53,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:10:53,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000003
2015-03-13 10:10:53,493 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:53,494 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:10:53,494 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000003
2015-03-13 10:10:53,494 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:10:53,494 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:10:53,494 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,494 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,495 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:10:53,495 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:10:53,661 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742081_1257 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:10:53,661 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742082_1258 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:10:53,662 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742083_1259 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:10:53,662 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742084_1260 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:10:53,662 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742089_1265 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:10:53,662 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742085_1261 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:10:53,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0022 dst=null perm=null
2015-03-13 10:10:53,686 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/2) ...dedpipesplatform/joinself
2015-03-13 10:10:53,693 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,700 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:10:53,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:53,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:53,705 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 23
2015-03-13 10:10:53,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=null
2015-03-13 10:10:53,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:10:53,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:10:53,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:53,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,711 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:53,713 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62720 dest: /127.0.0.1:60686
2015-03-13 10:10:53,714 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62721 dest: /127.0.0.1:60693
2015-03-13 10:10:53,715 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62722 dest: /127.0.0.1:60696
2015-03-13 10:10:53,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62722, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 2737000
2015-03-13 10:10:53,719 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,719 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,719 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62721, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 2644000
2015-03-13 10:10:53,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,720 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,720 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62720, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 3626000
2015-03-13 10:10:53,720 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,721 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742095_1271{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,722 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,723 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar
2015-03-13 10:10:53,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:53,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,725 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:53,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:53,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:53,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:10:53,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:10:53,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:10:53,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:10:53,730 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:10:53,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:53,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:53,732 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:10:53,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:10:53,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,736 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split
2015-03-13 10:10:53,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:53,737 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:10:53,738 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62723 dest: /127.0.0.1:60693
2015-03-13 10:10:53,739 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62724 dest: /127.0.0.1:60689
2015-03-13 10:10:53,740 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62725 dest: /127.0.0.1:60696
2015-03-13 10:10:53,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272 src: /127.0.0.1:62726 dest: /127.0.0.1:60686
2015-03-13 10:10:53,744 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62726, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 1561000
2015-03-13 10:10:53,744 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,744 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,744 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62725, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 2010000
2015-03-13 10:10:53,745 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,745 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,745 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62724, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 2762000
2015-03-13 10:10:53,745 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,746 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,746 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62723, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 3250000
2015-03-13 10:10:53,746 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,747 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742096_1272{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:10:53,748 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,751 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:10:53,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62727 dest: /127.0.0.1:60693
2015-03-13 10:10:53,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62728 dest: /127.0.0.1:60689
2015-03-13 10:10:53,754 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273 src: /127.0.0.1:62729 dest: /127.0.0.1:60696
2015-03-13 10:10:53,757 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62729, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 1326000
2015-03-13 10:10:53,757 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,757 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,758 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62728, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 2109000
2015-03-13 10:10:53,758 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,758 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,758 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62727, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 2946000
2015-03-13 10:10:53,759 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,759 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742097_1273{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:10:53,760 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,760 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:10:53,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:10:53,763 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:10:53,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:10:53,764 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:10:53,769 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:10:53,770 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62730 dest: /127.0.0.1:60693
2015-03-13 10:10:53,771 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62731 dest: /127.0.0.1:60686
2015-03-13 10:10:53,773 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274 src: /127.0.0.1:62732 dest: /127.0.0.1:60689
2015-03-13 10:10:53,775 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62732, dest: /127.0.0.1:60689, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 1374000
2015-03-13 10:10:53,775 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:53,776 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,776 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62731, dest: /127.0.0.1:60686, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 1826000
2015-03-13 10:10:53,776 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,776 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,777 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62730, dest: /127.0.0.1:60693, bytes: 97852, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 2565000
2015-03-13 10:10:53,777 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:53,779 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742098_1274{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:10:53,779 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:10:53,780 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0023
2015-03-13 10:10:53,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=null
2015-03-13 10:10:53,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:53,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:53,782 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:53,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:53,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:53,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:53,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:53,784 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:53,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:53,786 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:53,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:53,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:53,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:53,788 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:53,789 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 23 submitted by user soberoi
2015-03-13 10:10:53,789 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0023
2015-03-13 10:10:53,790 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0023
2015-03-13 10:10:53,790 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0023
2015-03-13 10:10:53,790 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from NEW to NEW_SAVING
2015-03-13 10:10:53,790 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:10:53,790 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,790 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from NEW to SUBMITTED
2015-03-13 10:10:53,790 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0023 from user: soberoi activated in queue: default
2015-03-13 10:10:53,790 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0023 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:10:53,791 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0023 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:10:53,791 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0023 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:10:53,791 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0023_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:10:53,792 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:10:53,792 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from SUBMITTED to ACCEPTED
2015-03-13 10:10:53,792 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0023/
2015-03-13 10:10:53,792 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0023
2015-03-13 10:10:53,793 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0023/
2015-03-13 10:10:53,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:53,895 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:53,895 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:10:53,895 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:10:53,895 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0023_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,895 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:10:53,896 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:53,896 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:53,896 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0023 AttemptId: appattempt_1426266260362_0023_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:10:53,897 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:10:53,897 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,897 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:10:53,897 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0023_000001
2015-03-13 10:10:53,898 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,898 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0023_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:10:53,900 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:53,901 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000001 by user soberoi
2015-03-13 10:10:53,901 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:53,901 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:10:53,901 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:53,901 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000001 to application application_1426266260362_0023
2015-03-13 10:10:53,901 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0023_000001
2015-03-13 10:10:53,902 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:53,902 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:10:53,902 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:10:53,902 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:53,902 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,902 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,902 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,903 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:53,903 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000001
2015-03-13 10:10:53,912 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0023_01_000001.tokens. Credentials list:
2015-03-13 10:10:53,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:53,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0023_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001.tokens
2015-03-13 10:10:53,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:54,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:54,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:54,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:54,067 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 498000
2015-03-13 10:10:54,086 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:54,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:54,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:54,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:54,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,098 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:54,098 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:54,099 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:54,102 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:54,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:54,103 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:54,111 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62737, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 126000
2015-03-13 10:10:54,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:54,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:54,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:10:54,145 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 128000
2015-03-13 10:10:54,157 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:54,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:54,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:54,180 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62736, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2000142493_12149, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 285000
2015-03-13 10:10:54,193 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:54,193 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:54,219 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:54,219 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:54,288 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001/default_container_executor.sh]
2015-03-13 10:10:54,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:54,297 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:54,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,298 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,447 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:54,448 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262
2015-03-13 10:10:54,448 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:54,448 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:54,653 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:54,653 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,653 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:54,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:54,699 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:54,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:54,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:54,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:54,852 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274
2015-03-13 10:10:54,853 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742094_1270
2015-03-13 10:10:54,897 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:54,897 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:54,897 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:54,979 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742095_1271 to datanode(s) 127.0.0.1:60689
2015-03-13 10:10:54,979 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:54,979 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:55,054 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742089_1265
2015-03-13 10:10:55,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742093_1269
2015-03-13 10:10:55,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266
2015-03-13 10:10:55,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263
2015-03-13 10:10:55,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273
2015-03-13 10:10:55,055 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272
2015-03-13 10:10:55,056 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267
2015-03-13 10:10:55,056 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264
2015-03-13 10:10:55,056 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268
2015-03-13 10:10:55,057 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:55,576 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:55,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:55,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:55,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:55,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:55,577 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:55,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:55,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:55,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:10:55,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED dst=null perm=null
2015-03-13 10:10:55,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:10:55,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_FAIL dst=null perm=null
2015-03-13 10:10:55,956 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 to 127.0.0.1:60689
2015-03-13 10:10:55,957 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:55,957 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:55,957 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:55,957 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:55,958 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:10:55,958 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:55,958 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62739 dest: /127.0.0.1:60689
2015-03-13 10:10:55,959 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:55,958 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:55,958 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:55,959 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:55,959 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:55,960 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:55,960 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:55,960 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271 src: /127.0.0.1:62739 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:10:55,961 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742095_1271 size 254067
2015-03-13 10:10:55,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=null
2015-03-13 10:10:55,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:10:55,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:10:56,278 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:56,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.splitmetainfo dst=null perm=null
2015-03-13 10:10:56,346 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62740, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742097_1273, duration: 156000
2015-03-13 10:10:56,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:56,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,134 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:57,136 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0023_000001
2015-03-13 10:10:57,136 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0023 APPATTEMPTID=appattempt_1426266260362_0023_000001
2015-03-13 10:10:57,136 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:10:57,136 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from ACCEPTED to RUNNING
2015-03-13 10:10:57,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:57,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:10:57,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:10:57,368 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:10:57,407 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62746 dest: /127.0.0.1:60696
2015-03-13 10:10:57,408 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62747 dest: /127.0.0.1:60686
2015-03-13 10:10:57,413 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275 src: /127.0.0.1:62748 dest: /127.0.0.1:60693
2015-03-13 10:10:57,421 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62748, dest: /127.0.0.1:60693, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 6306000
2015-03-13 10:10:57,421 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:10:57,421 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,422 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62747, dest: /127.0.0.1:60686, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 7052000
2015-03-13 10:10:57,422 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:57,422 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,422 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62746, dest: /127.0.0.1:60696, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 7819000
2015-03-13 10:10:57,423 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:10:57,423 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742099_1275{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:10:57,427 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:10:57,912 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,912 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:57,980 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742084_1260, blk_1073742085_1261, blk_1073742089_1265]
2015-03-13 10:10:57,980 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742081_1257, blk_1073742082_1258, blk_1073742083_1259]
2015-03-13 10:10:58,170 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,170 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:10:58,170 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:58,170 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,170 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:10:58,170 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,171 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:10:58,171 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:10:58,171 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,171 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:10:58,171 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,172 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:10:58,172 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:10:58,172 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:10:58,172 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,172 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,172 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:10:58,173 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:10:58,173 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0023_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,173 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:10:58,173 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,468 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:10:58,468 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:10:58,468 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:10:58,468 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0023 container=Container: [ContainerId: container_1426266260362_0023_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0023_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,468 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:10:58,469 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:58,574 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:58,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083 for deletion
2015-03-13 10:10:58,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:58,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:58,575 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742083_1259 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742083
2015-03-13 10:10:58,690 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0022_01_000001 succeeded
2015-03-13 10:10:58,690 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:10:58,690 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,697 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:58,698 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0022_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:10:58,698 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0022_01_000001 from application application_1426266260362_0022
2015-03-13 10:10:58,698 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:58,698 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0022
2015-03-13 10:10:58,697 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0022/container_1426266260362_0022_01_000001
2015-03-13 10:10:58,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081 for deletion
2015-03-13 10:10:58,778 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082 for deletion
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084 for deletion
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085 for deletion
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742082_1258 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742082
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089 for deletion
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742081_1257 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742081
2015-03-13 10:10:58,779 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742085_1261 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742085
2015-03-13 10:10:58,780 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742084_1260 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742084
2015-03-13 10:10:58,780 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742089_1265 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742089
2015-03-13 10:10:58,913 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 22 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:10:58,913 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0022_01_000001
2015-03-13 10:10:58,913 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:58,914 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0022_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:10:58,914 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0022_000001
2015-03-13 10:10:58,914 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0022_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:10:58,914 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0022_000001 State change from FINISHING to FINISHED
2015-03-13 10:10:58,914 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0022 CONTAINERID=container_1426266260362_0022_01_000001
2015-03-13 10:10:58,914 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0022 State change from FINISHING to FINISHED
2015-03-13 10:10:58,914 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0022_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:10:58,914 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0022_000001
2015-03-13 10:10:58,914 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:10:58,914 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0022
2015-03-13 10:10:58,915 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0022_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,915 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0022,name=[5C1ADEBEAF9544CFBB574223654F352B/C41347FCE26941FD99688B6E707F843A] lower*upper/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0022/jobhistory/job/job_1426266260362_0022,appMasterHost=Edinburgh.local,startTime=1426266637614,finishTime=1426266652655,finalStatus=SUCCEEDED
2015-03-13 10:10:58,915 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:10:58,915 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:10:58,915 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0022_000001 released container container_1426266260362_0022_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:10:58,915 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0022_000001 is done. finalState=FINISHED
2015-03-13 10:10:58,916 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0022 requests cleared
2015-03-13 10:10:58,916 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0022 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:10:58,916 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0022 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:10:58,917 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0022_000001 (auth:SIMPLE)
2015-03-13 10:10:58,918 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0022_01_000001
2015-03-13 10:10:59,106 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271
2015-03-13 10:10:59,172 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,172 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,172 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,173 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,172 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,174 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,175 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:10:59,202 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:59,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:59,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:59,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:59,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:10:59,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:10:59,300 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:59,300 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:10:59,303 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000005 by user soberoi
2015-03-13 10:10:59,303 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000004 by user soberoi
2015-03-13 10:10:59,303 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000006 by user soberoi
2015-03-13 10:10:59,303 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:10:59,303 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:59,303 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000004 to application application_1426266260362_0023
2015-03-13 10:10:59,303 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0023
2015-03-13 10:10:59,304 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000006 to application application_1426266260362_0023
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from NEW to INITING
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000005 to application application_1426266260362_0023
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:59,305 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,305 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,305 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,305 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,305 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,305 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,305 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000006
2015-03-13 10:10:59,304 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from INITING to RUNNING
2015-03-13 10:10:59,306 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,305 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000002 by user soberoi
2015-03-13 10:10:59,306 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:10:59,306 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0023_01_000003 by user soberoi
2015-03-13 10:10:59,307 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:10:59,306 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,307 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,307 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,307 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,307 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,307 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:10:59,308 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,308 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,308 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,308 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,308 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000002 to application application_1426266260362_0023
2015-03-13 10:10:59,308 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0023_01_000003 to application application_1426266260362_0023
2015-03-13 10:10:59,308 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000005
2015-03-13 10:10:59,309 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000004
2015-03-13 10:10:59,309 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,310 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,310 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0023
2015-03-13 10:10:59,310 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:10:59,310 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0023
2015-03-13 10:10:59,310 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000002
2015-03-13 10:10:59,312 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0023_01_000003
2015-03-13 10:10:59,331 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000005.tokens. Credentials list:
2015-03-13 10:10:59,331 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0023_01_000006.tokens. Credentials list:
2015-03-13 10:10:59,332 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000004.tokens. Credentials list:
2015-03-13 10:10:59,332 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000003.tokens. Credentials list:
2015-03-13 10:10:59,333 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0023_01_000002.tokens. Credentials list:
2015-03-13 10:10:59,352 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:59,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:10:59,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0023_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006.tokens
2015-03-13 10:10:59,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:59,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005.tokens
2015-03-13 10:10:59,430 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:10:59,468 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:59,468 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:10:59,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,500 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar dst=null perm=null
2015-03-13 10:10:59,509 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62756, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_727660181_12297, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 458000
2015-03-13 10:10:59,510 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62757, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1315627514_12296, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742095_1271, duration: 508000
2015-03-13 10:10:59,518 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,519 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,519 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,519 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,536 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,536 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml dst=null perm=null
2015-03-13 10:10:59,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62756, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1315627514_12296, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 236000
2015-03-13 10:10:59,565 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62758, bytes: 98620, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_727660181_12297, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742098_1274, duration: 254000
2015-03-13 10:10:59,579 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,579 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,580 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,579 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,579 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:10:59,580 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,580 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:10:59,631 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,631 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,632 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,632 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,632 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,632 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,633 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,633 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,633 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:10:59,634 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:10:59,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:10:59,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005/default_container_executor.sh]
2015-03-13 10:10:59,769 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002/default_container_executor.sh]
2015-03-13 10:10:59,769 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006/default_container_executor.sh]
2015-03-13 10:10:59,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004/default_container_executor.sh]
2015-03-13 10:10:59,770 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003/default_container_executor.sh]
2015-03-13 10:10:59,860 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:10:59,914 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:10:59,914 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:10:59,914 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,915 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,915 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0022
2015-03-13 10:10:59,915 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0022 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:10:59,915 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0022, with delay of 10800 seconds
2015-03-13 10:10:59,915 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:10:59,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0022
2015-03-13 10:11:00,065 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275
2015-03-13 10:11:00,176 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,177 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,177 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,177 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,178 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:00,188 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:11:00,473 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,608 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:00,724 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0023_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002.tokens
2015-03-13 10:11:00,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:00,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:00,915 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:00,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003.tokens
2015-03-13 10:11:00,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:01,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:01,174 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/nmPrivate/container_1426266260362_0023_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004.tokens
2015-03-13 10:11:01,174 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:01,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,478 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:01,917 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,480 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:02,918 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,484 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:03,922 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,188 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:04,924 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,191 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,191 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,192 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,490 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:05,929 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,194 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,195 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,494 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:06,931 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,198 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,198 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,199 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,496 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:11:07,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:11:07,760 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:11:07,786 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62769, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 143000
2015-03-13 10:11:07,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:11:07,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job.split dst=null perm=null
2015-03-13 10:11:07,862 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62773, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 161000
2015-03-13 10:11:07,921 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62775, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 150000
2015-03-13 10:11:07,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:07,931 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62769, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 167000
2015-03-13 10:11:07,933 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62774, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 155000
2015-03-13 10:11:07,938 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:07,958 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:07,970 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62776, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742096_1272, duration: 155000
2015-03-13 10:11:07,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:08,001 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62777, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:11:08,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:08,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:08,072 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62774, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 144000
2015-03-13 10:11:08,077 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:08,103 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62778, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:11:08,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,203 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,434 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62779, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 151000
2015-03-13 10:11:08,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,455 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62780, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 144000
2015-03-13 10:11:08,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,465 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62781, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 176000
2015-03-13 10:11:08,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,471 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62779, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 153000
2015-03-13 10:11:08,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62782, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 149000
2015-03-13 10:11:08,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 137000
2015-03-13 10:11:08,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,508 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:08,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,521 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,524 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 159000
2015-03-13 10:11:08,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,534 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62783, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 148000
2015-03-13 10:11:08,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62785, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 153000
2015-03-13 10:11:08,543 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62786, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 180000
2015-03-13 10:11:08,550 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62784 dest: /127.0.0.1:60686
2015-03-13 10:11:08,551 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62787 dest: /127.0.0.1:60696
2015-03-13 10:11:08,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276 src: /127.0.0.1:62788 dest: /127.0.0.1:60693
2015-03-13 10:11:08,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,560 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62788, dest: /127.0.0.1:60693, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 5855000
2015-03-13 10:11:08,560 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,561 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,561 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62787, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 6890000
2015-03-13 10:11:08,561 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,562 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62784, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 8089000
2015-03-13 10:11:08,562 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,562 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,563 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742100_1276{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:08,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:08,567 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0023_m_000002_0_-52856569_1
2015-03-13 10:11:08,577 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0 dst=null perm=null
2015-03-13 10:11:08,578 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:08,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0 dst=null perm=null
2015-03-13 10:11:08,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002 dst=null perm=null
2015-03-13 10:11:08,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,609 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000004
2015-03-13 10:11:08,609 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,609 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,610 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000004
2015-03-13 10:11:08,610 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,610 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,610 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,611 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,622 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000004 is : 143
2015-03-13 10:11:08,625 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:08,627 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62790 dest: /127.0.0.1:60689
2015-03-13 10:11:08,628 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62791 dest: /127.0.0.1:60686
2015-03-13 10:11:08,630 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278 src: /127.0.0.1:62792 dest: /127.0.0.1:60693
2015-03-13 10:11:08,634 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,634 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist for DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:08,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,635 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000004 from application application_1426266260362_0023
2015-03-13 10:11:08,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,636 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000004
2015-03-13 10:11:08,635 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,636 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62789 dest: /127.0.0.1:60689
2015-03-13 10:11:08,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62793 dest: /127.0.0.1:60696
2015-03-13 10:11:08,653 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277 src: /127.0.0.1:62794 dest: /127.0.0.1:60686
2015-03-13 10:11:08,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,661 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62794, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 7181000
2015-03-13 10:11:08,661 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,662 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,662 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62793, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 7821000
2015-03-13 10:11:08,662 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,662 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,663 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62789, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 8551000
2015-03-13 10:11:08,663 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,663 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742101_1277{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:08,668 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0023_m_000001_0_-1932647283_1
2015-03-13 10:11:08,669 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 147000
2015-03-13 10:11:08,680 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,688 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 166000
2015-03-13 10:11:08,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0 dst=null perm=null
2015-03-13 10:11:08,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0 dst=null perm=null
2015-03-13 10:11:08,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001 dst=null perm=null
2015-03-13 10:11:08,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62797, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 155000
2015-03-13 10:11:08,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,715 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,716 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000003
2015-03-13 10:11:08,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,716 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,717 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000004
2015-03-13 10:11:08,717 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,717 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,717 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,717 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000004
2015-03-13 10:11:08,717 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:08,717 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:08,718 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000004, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,718 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,719 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:08,719 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000004 on node: host: 10.1.1.144:60723 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:08,729 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 164000
2015-03-13 10:11:08,730 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000003 is : 143
2015-03-13 10:11:08,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,736 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62795, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 139000
2015-03-13 10:11:08,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,741 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 141000
2015-03-13 10:11:08,742 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62798, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 127000
2015-03-13 10:11:08,743 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,743 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,744 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,745 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000003 from application application_1426266260362_0023
2015-03-13 10:11:08,745 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,745 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,747 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62775, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 165000
2015-03-13 10:11:08,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00000 dst=null perm=null
2015-03-13 10:11:08,750 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62799, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 135000
2015-03-13 10:11:08,751 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62776, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742090_1266, duration: 124000
2015-03-13 10:11:08,753 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,754 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,756 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62796, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 151000
2015-03-13 10:11:08,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,766 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62800, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 145000
2015-03-13 10:11:08,770 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:08,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00001 dst=null perm=null
2015-03-13 10:11:08,774 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62801, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742091_1267, duration: 154000
2015-03-13 10:11:08,780 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0023_m_000004_0_-330135731_1
2015-03-13 10:11:08,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,781 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00002 dst=null perm=null
2015-03-13 10:11:08,793 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62803, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742087_1263, duration: 149000
2015-03-13 10:11:08,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0 dst=null perm=null
2015-03-13 10:11:08,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00003 dst=null perm=null
2015-03-13 10:11:08,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0 dst=null perm=null
2015-03-13 10:11:08,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004 dst=null perm=null
2015-03-13 10:11:08,803 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62804, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742088_1264, duration: 152000
2015-03-13 10:11:08,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,806 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703/part-00004 dst=null perm=null
2015-03-13 10:11:08,810 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62803, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742086_1262, duration: 143000
2015-03-13 10:11:08,812 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62802 dest: /127.0.0.1:60693
2015-03-13 10:11:08,814 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62805 dest: /127.0.0.1:60689
2015-03-13 10:11:08,815 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279 src: /127.0.0.1:62806 dest: /127.0.0.1:60696
2015-03-13 10:11:08,821 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000006
2015-03-13 10:11:08,821 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:08,822 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,822 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000006
2015-03-13 10:11:08,822 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,833 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62806, dest: /127.0.0.1:60696, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 16462000
2015-03-13 10:11:08,834 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,834 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,834 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62805, dest: /127.0.0.1:60689, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 17553000
2015-03-13 10:11:08,835 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,835 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000006 is : 143
2015-03-13 10:11:08,835 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62802, dest: /127.0.0.1:60693, bytes: 16, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 18474000
2015-03-13 10:11:08,836 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,835 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,836 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742103_1279{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,842 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0023_m_000000_0_1749206131_1
2015-03-13 10:11:08,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,847 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,848 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000006
2015-03-13 10:11:08,847 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000006 from application application_1426266260362_0023
2015-03-13 10:11:08,848 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,848 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,851 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:08,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0 dst=null perm=null
2015-03-13 10:11:08,861 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0 dst=null perm=null
2015-03-13 10:11:08,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000 dst=null perm=null
2015-03-13 10:11:08,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,888 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000002
2015-03-13 10:11:08,888 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,889 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,889 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000002
2015-03-13 10:11:08,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000003
2015-03-13 10:11:08,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,890 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,890 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,890 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000003
2015-03-13 10:11:08,890 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:08,890 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:08,891 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,891 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,891 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:08,891 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000003 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:08,902 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000002 is : 143
2015-03-13 10:11:08,904 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62807 dest: /127.0.0.1:60686
2015-03-13 10:11:08,906 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62808 dest: /127.0.0.1:60689
2015-03-13 10:11:08,907 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280 src: /127.0.0.1:62809 dest: /127.0.0.1:60696
2015-03-13 10:11:08,915 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,916 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62809, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 7315000
2015-03-13 10:11:08,916 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,916 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:08,916 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62808, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 7812000
2015-03-13 10:11:08,916 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,916 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,917 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,917 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62807, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 8526000
2015-03-13 10:11:08,917 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:08,918 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742104_1280{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:08,918 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,918 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,919 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,919 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000002 from application application_1426266260362_0023
2015-03-13 10:11:08,919 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,919 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,924 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0023_m_000003_0_1427193032_1
2015-03-13 10:11:08,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0 dst=null perm=null
2015-03-13 10:11:08,939 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:08,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0 dst=null perm=null
2015-03-13 10:11:08,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003 dst=null perm=null
2015-03-13 10:11:08,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/_temporary/attempt_1426266260362_0023_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:08,960 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000005
2015-03-13 10:11:08,961 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:08,961 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:08,961 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:08,961 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000002
2015-03-13 10:11:08,961 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:08,961 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:08,962 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000005
2015-03-13 10:11:08,962 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:08,962 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000002
2015-03-13 10:11:08,962 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:08,962 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:08,963 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,963 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:08,963 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:08,963 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000002 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:08,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,968 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:08,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1 dst=null perm=null
2015-03-13 10:11:08,975 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0023_01_000005 is : 143
2015-03-13 10:11:08,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000 dst=null perm=null
2015-03-13 10:11:08,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2015-03-13 10:11:08,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,988 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:08,988 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,989 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000005
2015-03-13 10:11:08,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,990 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:08,991 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:08,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,991 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000005 from application application_1426266260362_0023
2015-03-13 10:11:08,991 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:08,991 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:08,992 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001 dst=null perm=null
2015-03-13 10:11:08,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2015-03-13 10:11:08,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,995 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:08,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002 dst=null perm=null
2015-03-13 10:11:08,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2015-03-13 10:11:08,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:08,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:09,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:09,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003 dst=null perm=null
2015-03-13 10:11:09,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2015-03-13 10:11:09,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:09,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:09,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004 dst=null perm=null
2015-03-13 10:11:09,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2015-03-13 10:11:09,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary/1/task_1426266260362_0023_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,015 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary dst=null perm=null
2015-03-13 10:11:09,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,021 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,025 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,037 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62792, dest: /127.0.0.1:60693, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 405561000
2015-03-13 10:11:09,037 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,040 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62791, dest: /127.0.0.1:60686, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 408089000
2015-03-13 10:11:09,040 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,041 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,041 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62790, dest: /127.0.0.1:60689, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 408876000
2015-03-13 10:11:09,041 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,041 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742102_1278{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,043 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,046 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:09,048 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62810 dest: /127.0.0.1:60686
2015-03-13 10:11:09,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62811 dest: /127.0.0.1:60696
2015-03-13 10:11:09,050 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281 src: /127.0.0.1:62812 dest: /127.0.0.1:60689
2015-03-13 10:11:09,053 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62812, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 1199000
2015-03-13 10:11:09,053 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,053 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62811, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 1687000
2015-03-13 10:11:09,053 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,054 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,054 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62810, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 2434000
2015-03-13 10:11:09,054 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,054 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742105_1281{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:09,056 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist dst=null perm=null
2015-03-13 10:11:09,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:09,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist dst=null perm=null
2015-03-13 10:11:09,071 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:09,072 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1.jhist dst=null perm=null
2015-03-13 10:11:09,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,077 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62813, bytes: 53738, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278, duration: 177000
2015-03-13 10:11:09,079 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:09,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62814 dest: /127.0.0.1:60689
2015-03-13 10:11:09,081 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62815 dest: /127.0.0.1:60693
2015-03-13 10:11:09,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282 src: /127.0.0.1:62816 dest: /127.0.0.1:60686
2015-03-13 10:11:09,085 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62816, dest: /127.0.0.1:60686, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 1686000
2015-03-13 10:11:09,085 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,086 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62815, dest: /127.0.0.1:60693, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 2134000
2015-03-13 10:11:09,086 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,086 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,087 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62814, dest: /127.0.0.1:60689, bytes: 53318, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, duration: 3161000
2015-03-13 10:11:09,087 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,088 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,088 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742106_1282{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:09,090 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml dst=null perm=null
2015-03-13 10:11:09,095 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:09,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml dst=null perm=null
2015-03-13 10:11:09,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:09,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023/job_1426266260362_0023_1_conf.xml dst=null perm=null
2015-03-13 10:11:09,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:09,101 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62813, bytes: 91376, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742099_1275, duration: 240000
2015-03-13 10:11:09,103 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:09,104 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62817 dest: /127.0.0.1:60686
2015-03-13 10:11:09,106 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62818 dest: /127.0.0.1:60689
2015-03-13 10:11:09,107 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283 src: /127.0.0.1:62819 dest: /127.0.0.1:60693
2015-03-13 10:11:09,110 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,110 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62819, dest: /127.0.0.1:60693, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 1932000
2015-03-13 10:11:09,110 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:09,110 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:09,111 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62818, dest: /127.0.0.1:60689, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 2451000
2015-03-13 10:11:09,111 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:09,111 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,111 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,112 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62817, dest: /127.0.0.1:60686, bytes: 90664, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-872052556_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, duration: 3270000
2015-03-13 10:11:09,112 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:09,112 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,112 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,113 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742107_1283{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:09,113 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:09,113 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:09,114 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,114 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-872052556_1
2015-03-13 10:11:09,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:09,128 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:09,128 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0023
2015-03-13 10:11:09,128 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from RUNNING to REMOVING
2015-03-13 10:11:09,128 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0023
2015-03-13 10:11:09,128 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from REMOVING to FINISHING
2015-03-13 10:11:09,719 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:09,720 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,721 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,722 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,722 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:09,823 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:09,823 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000006
2015-03-13 10:11:09,823 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:09,823 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:09,823 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000006
2015-03-13 10:11:09,824 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:09,824 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:09,825 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,825 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,825 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:09,825 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:09,869 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742107_1283
2015-03-13 10:11:09,870 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:09,870 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:09,870 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:09,871 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742106_1282
2015-03-13 10:11:09,871 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742102_1278
2015-03-13 10:11:09,872 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:09,941 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:09,964 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:09,964 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000005
2015-03-13 10:11:09,965 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:09,965 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:09,965 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000005
2015-03-13 10:11:09,965 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:09,966 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:09,966 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000005, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,966 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:09,966 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:09,967 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000005 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:10,078 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279
2015-03-13 10:11:10,078 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280
2015-03-13 10:11:10,079 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276
2015-03-13 10:11:10,079 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277
2015-03-13 10:11:10,079 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281
2015-03-13 10:11:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742095_1271 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:11:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742096_1272 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:11:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742097_1273 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:10,133 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742098_1274 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:11:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742102_1278 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:11:10,134 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742099_1275 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:11:10,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0023 dst=null perm=null
2015-03-13 10:11:10,174 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742090_1266 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:10,174 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742091_1267 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:11:10,174 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742087_1263 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:11:10,174 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742088_1264 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:11:10,175 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742086_1262 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:11:10,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/997406188_upper_DFB17D7590E049D1B2FF7F1B2EFF8703 dst=null perm=null
2015-03-13 10:11:10,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,176 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary
2015-03-13 10:11:10,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/_temporary dst=null perm=null
2015-03-13 10:11:10,183 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,183 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,184 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,187 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:10,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2015-03-13 10:11:10,189 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62821, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 120000
2015-03-13 10:11:10,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2015-03-13 10:11:10,192 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 159000
2015-03-13 10:11:10,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2015-03-13 10:11:10,193 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 130000
2015-03-13 10:11:10,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2015-03-13 10:11:10,195 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 144000
2015-03-13 10:11:10,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2015-03-13 10:11:10,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,202 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,206 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:10,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2015-03-13 10:11:10,208 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 176000
2015-03-13 10:11:10,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2015-03-13 10:11:10,210 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62821, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 141000
2015-03-13 10:11:10,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2015-03-13 10:11:10,212 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 157000
2015-03-13 10:11:10,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2015-03-13 10:11:10,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 135000
2015-03-13 10:11:10,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2015-03-13 10:11:10,214 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinself
2015-03-13 10:11:10,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself dst=null perm=null
2015-03-13 10:11:10,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2015-03-13 10:11:10,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00000 dst=null perm=null
2015-03-13 10:11:10,218 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 20, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742103_1279, duration: 118000
2015-03-13 10:11:10,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2015-03-13 10:11:10,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00001 dst=null perm=null
2015-03-13 10:11:10,221 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62824, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742101_1277, duration: 172000
2015-03-13 10:11:10,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2015-03-13 10:11:10,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00002 dst=null perm=null
2015-03-13 10:11:10,223 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742100_1276, duration: 168000
2015-03-13 10:11:10,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2015-03-13 10:11:10,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00003 dst=null perm=null
2015-03-13 10:11:10,226 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742104_1280, duration: 163000
2015-03-13 10:11:10,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2015-03-13 10:11:10,227 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinself/part-00004 dst=null perm=null
2015-03-13 10:11:10,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:10,229 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:10,237 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,238 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:11:10,238 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:11:10,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:10,259 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] starting
2015-03-13 10:11:10,259 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped"]
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] parallel execution is enabled: true
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] starting jobs: 2
2015-03-13 10:11:10,260 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [upper2*lower*upper1] allocating threads: 2
2015-03-13 10:11:10,261 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] starting step: (2/2)
2015-03-13 10:11:10,280 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,288 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:10,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:10,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:10,292 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 24
2015-03-13 10:11:10,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=null
2015-03-13 10:11:10,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:10,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:11:10,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,298 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:10,299 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62826 dest: /127.0.0.1:60686
2015-03-13 10:11:10,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62827 dest: /127.0.0.1:60693
2015-03-13 10:11:10,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62828 dest: /127.0.0.1:60689
2015-03-13 10:11:10,305 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62828, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 1897000
2015-03-13 10:11:10,306 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,306 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,306 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62827, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 2555000
2015-03-13 10:11:10,306 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,307 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62826, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 3008000
2015-03-13 10:11:10,307 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,307 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742108_1284{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:10,308 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,309 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar
2015-03-13 10:11:10,309 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:10,312 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:10,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:10,313 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:11:10,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:11:10,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:11:10,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:11:10,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:11:10,316 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:10,318 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:10,318 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:10,319 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:10,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,322 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split
2015-03-13 10:11:10,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,323 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:10,325 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62829 dest: /127.0.0.1:60689
2015-03-13 10:11:10,326 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62830 dest: /127.0.0.1:60693
2015-03-13 10:11:10,327 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62831 dest: /127.0.0.1:60696
2015-03-13 10:11:10,328 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285 src: /127.0.0.1:62832 dest: /127.0.0.1:60686
2015-03-13 10:11:10,331 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62832, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 1527000
2015-03-13 10:11:10,331 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,331 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,331 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62831, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 1848000
2015-03-13 10:11:10,332 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,332 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,332 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62830, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 2631000
2015-03-13 10:11:10,332 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,333 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,333 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62829, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 3443000
2015-03-13 10:11:10,333 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,334 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742109_1285{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:10,335 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,338 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:10,339 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62833 dest: /127.0.0.1:60686
2015-03-13 10:11:10,340 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62834 dest: /127.0.0.1:60689
2015-03-13 10:11:10,341 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286 src: /127.0.0.1:62835 dest: /127.0.0.1:60696
2015-03-13 10:11:10,343 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62835, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 1197000
2015-03-13 10:11:10,344 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,344 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62834, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 1546000
2015-03-13 10:11:10,344 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,344 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,345 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62833, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 2287000
2015-03-13 10:11:10,345 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,345 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742110_1286{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,346 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,346 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:10,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:10,349 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:10,350 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:10,350 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:10,352 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:10,354 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62836 dest: /127.0.0.1:60693
2015-03-13 10:11:10,355 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62837 dest: /127.0.0.1:60689
2015-03-13 10:11:10,356 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287 src: /127.0.0.1:62838 dest: /127.0.0.1:60696
2015-03-13 10:11:10,359 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62838, dest: /127.0.0.1:60696, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 1344000
2015-03-13 10:11:10,359 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:10,359 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,359 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62837, dest: /127.0.0.1:60689, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 1694000
2015-03-13 10:11:10,360 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,360 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,360 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62836, dest: /127.0.0.1:60693, bytes: 97854, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 2469000
2015-03-13 10:11:10,360 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:10,361 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742111_1287{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:10,362 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:10,362 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0024
2015-03-13 10:11:10,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=null
2015-03-13 10:11:10,363 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:10,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:10,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,365 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:10,368 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:10,370 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:10,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:10,371 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:10,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:10,373 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:10,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:10,375 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 24 submitted by user soberoi
2015-03-13 10:11:10,375 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0024
2015-03-13 10:11:10,375 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0024
2015-03-13 10:11:10,375 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0024
2015-03-13 10:11:10,375 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from NEW to NEW_SAVING
2015-03-13 10:11:10,376 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:10,376 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:10,376 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0024 from user: soberoi activated in queue: default
2015-03-13 10:11:10,376 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0024 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:10,377 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0024 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:10,377 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0024 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:10,377 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0024_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:10,377 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:10,378 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:10,379 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0024/
2015-03-13 10:11:10,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] submitted hadoop job: job_1426266260362_0024
2015-03-13 10:11:10,380 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0024/
2015-03-13 10:11:10,542 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:10,542 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:10,542 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:10,542 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0024_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:10,542 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:10,542 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:10,542 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:10,543 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0024 AttemptId: appattempt_1426266260362_0024_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:11:10,543 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:10,543 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,544 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:10,544 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0024_000001
2015-03-13 10:11:10,544 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,545 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0024_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:11:10,547 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:10,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000001 by user soberoi
2015-03-13 10:11:10,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:10,548 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:10,548 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:10,548 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000001 to application application_1426266260362_0024
2015-03-13 10:11:10,548 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0024_000001
2015-03-13 10:11:10,548 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:10,549 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:10,549 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:10,549 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:10,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,549 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:10,550 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000001
2015-03-13 10:11:10,559 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0024_01_000001.tokens. Credentials list:
2015-03-13 10:11:10,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:10,642 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0024_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001.tokens
2015-03-13 10:11:10,642 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:10,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,703 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:10,709 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 525000
2015-03-13 10:11:10,728 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:10,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:10,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:10,750 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62822, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 161000
2015-03-13 10:11:10,763 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:10,785 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 145000
2015-03-13 10:11:10,797 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:10,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:10,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:10,822 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62823, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1604125116_12714, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 266000
2015-03-13 10:11:10,835 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:10,835 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:10,859 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:10,859 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:10,926 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001/default_container_executor.sh]
2015-03-13 10:11:10,942 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:11,545 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:11,546 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:11,946 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:12,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED dst=null perm=null
2015-03-13 10:11:12,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:11:12,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_FAIL dst=null perm=null
2015-03-13 10:11:12,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=null
2015-03-13 10:11:12,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:11:12,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:11:12,549 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,787 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:12,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:12,847 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62843, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286, duration: 129000
2015-03-13 10:11:12,951 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:12,996 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742108_1284 to datanode(s) 127.0.0.1:60696
2015-03-13 10:11:12,996 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742096_1272, blk_1073742098_1274, blk_1073742099_1275, blk_1073742086_1262, blk_1073742102_1278, blk_1073742087_1263, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:12,996 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742098_1274, blk_1073742086_1262, blk_1073742102_1278, blk_1073742087_1263, blk_1073742088_1264, blk_1073742090_1266, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:13,553 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:13,587 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 to 127.0.0.1:60696
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:13,587 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:13,588 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:13,588 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:13,589 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62847 dest: /127.0.0.1:60696
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:13,589 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:13,591 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:13,590 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:13,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284 src: /127.0.0.1:62847 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:11:13,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:13,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:13,592 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742108_1284 size 254067
2015-03-13 10:11:13,637 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:13,638 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0024_000001
2015-03-13 10:11:13,638 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0024 APPATTEMPTID=appattempt_1426266260362_0024_000001
2015-03-13 10:11:13,638 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:13,638 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from ACCEPTED to RUNNING
2015-03-13 10:11:13,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:13,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:13,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:13,852 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:13,892 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62850 dest: /127.0.0.1:60693
2015-03-13 10:11:13,893 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62851 dest: /127.0.0.1:60689
2015-03-13 10:11:13,895 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288 src: /127.0.0.1:62852 dest: /127.0.0.1:60686
2015-03-13 10:11:13,901 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62852, dest: /127.0.0.1:60686, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 4839000
2015-03-13 10:11:13,901 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:13,902 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,902 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62851, dest: /127.0.0.1:60689, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 5505000
2015-03-13 10:11:13,902 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:13,902 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,903 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62850, dest: /127.0.0.1:60693, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 6245000
2015-03-13 10:11:13,903 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:13,903 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742112_1288{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:13,907 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:13,955 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,116 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,118 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,319 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:14,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:14,320 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,557 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,725 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,727 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,832 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,832 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:14,832 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:14,832 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,833 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:14,833 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,833 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,833 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:14,833 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:14,834 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,834 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:14,834 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,834 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,834 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:14,835 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:14,835 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,835 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:14,835 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,835 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,835 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:14,835 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:11:14,836 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0024_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,836 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:14,836 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,879 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:14,880 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:14,881 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:14,882 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,931 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288
2015-03-13 10:11:14,932 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:14,958 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:14,958 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:14,959 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:14,959 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:11:14,959 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0024 container=Container: [ContainerId: container_1426266260362_0024_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0024_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:14,959 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:14,959 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742110_1286
2015-03-13 10:11:15,083 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287
2015-03-13 10:11:15,084 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285
2015-03-13 10:11:15,085 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284
2015-03-13 10:11:15,165 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0023_01_000001 succeeded
2015-03-13 10:11:15,165 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:15,165 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0023/container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:11:15,173 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0023_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:15,174 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0023_01_000001 from application application_1426266260362_0023
2015-03-13 10:11:15,174 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:15,174 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0023
2015-03-13 10:11:15,559 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,669 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:15,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:15,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:15,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:15,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:15,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:15,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:15,714 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:15,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:15,716 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:15,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:15,790 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:15,790 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:15,793 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000003 by user soberoi
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000006 by user soberoi
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0024
2015-03-13 10:11:15,794 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:15,794 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:15,794 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000003 to application application_1426266260362_0024
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000005 by user soberoi
2015-03-13 10:11:15,794 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:15,795 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:15,795 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000002 by user soberoi
2015-03-13 10:11:15,794 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:15,795 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:15,795 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,795 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,795 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,796 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,796 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000005 to application application_1426266260362_0024
2015-03-13 10:11:15,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,796 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000002 to application application_1426266260362_0024
2015-03-13 10:11:15,794 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from NEW to INITING
2015-03-13 10:11:15,796 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000006 to application application_1426266260362_0024
2015-03-13 10:11:15,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,796 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000003
2015-03-13 10:11:15,794 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0024_01_000004 by user soberoi
2015-03-13 10:11:15,796 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from INITING to RUNNING
2015-03-13 10:11:15,797 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:15,797 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,797 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,797 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,797 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,797 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,797 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,798 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0024_01_000004 to application application_1426266260362_0024
2015-03-13 10:11:15,798 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,798 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,798 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,798 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,798 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000005
2015-03-13 10:11:15,797 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:15,799 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000006
2015-03-13 10:11:15,799 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:15,799 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000002
2015-03-13 10:11:15,800 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,800 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0024
2015-03-13 10:11:15,800 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:15,800 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0024
2015-03-13 10:11:15,801 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0024_01_000004
2015-03-13 10:11:15,822 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0024_01_000003.tokens. Credentials list:
2015-03-13 10:11:15,823 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0024_01_000002.tokens. Credentials list:
2015-03-13 10:11:15,823 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0024_01_000006.tokens. Credentials list:
2015-03-13 10:11:15,824 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0024_01_000004.tokens. Credentials list:
2015-03-13 10:11:15,824 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0024_01_000005.tokens. Credentials list:
2015-03-13 10:11:15,832 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,833 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,833 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,834 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,834 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:15,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:15,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0024_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006.tokens
2015-03-13 10:11:15,921 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:15,922 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0024_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003.tokens
2015-03-13 10:11:15,922 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:15,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 23 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:15,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0023_01_000001
2015-03-13 10:11:15,959 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:15,960 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:15,960 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0023_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:15,960 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0023_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:15,960 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0023 CONTAINERID=container_1426266260362_0023_01_000001
2015-03-13 10:11:15,960 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0023_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:15,960 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:15,960 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0023_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,960 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:15,960 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:15,960 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0023_000001 released container container_1426266260362_0023_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:15,960 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0023_000001
2015-03-13 10:11:15,961 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0023_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:15,961 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0023 State change from FINISHING to FINISHED
2015-03-13 10:11:15,961 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0023_000001 is done. finalState=FINISHED
2015-03-13 10:11:15,961 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0023_000001
2015-03-13 10:11:15,961 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0023 requests cleared
2015-03-13 10:11:15,961 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0023 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:15,961 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0023 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:15,961 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0023
2015-03-13 10:11:15,962 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0023,name=[5C1ADEBEAF9544CFBB574223654F352B/D216C764973C483CA6D2DDC3E72E5438] lower*upper/(1/2) ...dedpipesplatform/joinself,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0023/jobhistory/job/job_1426266260362_0023,appMasterHost=Edinburgh.local,startTime=1426266653789,finishTime=1426266669128,finalStatus=SUCCEEDED
2015-03-13 10:11:15,963 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0023_000001 (auth:SIMPLE)
2015-03-13 10:11:15,965 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0023_01_000001
2015-03-13 10:11:15,986 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:15,986 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:15,987 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:15,987 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:15,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,987 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:15,997 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742098_1274, blk_1073742099_1275, blk_1073742086_1262, blk_1073742102_1278, blk_1073742088_1264, blk_1073742090_1266, blk_1073742095_1271]
2015-03-13 10:11:15,997 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742096_1272, blk_1073742097_1273, blk_1073742099_1275, blk_1073742087_1263, blk_1073742088_1264, blk_1073742090_1266, blk_1073742091_1267, blk_1073742095_1271]
2015-03-13 10:11:16,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar dst=null perm=null
2015-03-13 10:11:16,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62860, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-599587954_12860, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 353000
2015-03-13 10:11:16,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62861, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1431582356_12859, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742108_1284, duration: 538000
2015-03-13 10:11:16,039 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,039 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml dst=null perm=null
2015-03-13 10:11:16,066 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62861, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-599587954_12860, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 259000
2015-03-13 10:11:16,066 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62862, bytes: 98622, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1431582356_12859, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742111_1287, duration: 251000
2015-03-13 10:11:16,081 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,081 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,082 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,082 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:16,081 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:16,129 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,129 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,131 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,131 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,131 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,132 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,143 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,143 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,144 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:16,144 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:16,264 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004/default_container_executor.sh]
2015-03-13 10:11:16,271 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005/default_container_executor.sh]
2015-03-13 10:11:16,271 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002/default_container_executor.sh]
2015-03-13 10:11:16,292 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003/default_container_executor.sh]
2015-03-13 10:11:16,295 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006/default_container_executor.sh]
2015-03-13 10:11:16,560 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,683 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:11:16,792 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:16,792 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:16,792 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:16,792 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742098_1274 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742098
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742102_1278 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742102
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:16,793 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742086_1262 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742086
2015-03-13 10:11:16,794 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:16,794 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:16,838 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,839 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:16,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:16,840 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:16,840 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:16,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,840 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,961 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:16,961 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:16,962 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,962 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,962 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0023
2015-03-13 10:11:16,962 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0023 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:16,962 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0023, with delay of 10800 seconds
2015-03-13 10:11:16,962 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,963 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0023
2015-03-13 10:11:16,973 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096 for deletion
2015-03-13 10:11:16,973 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742096_1272 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742096
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742097_1273 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742097
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742099_1275 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742099
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742088_1264 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742088
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095 for deletion
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742087_1263 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742087
2015-03-13 10:11:16,974 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742090_1266 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742090
2015-03-13 10:11:16,975 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742091_1267 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742091
2015-03-13 10:11:16,975 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742095_1271 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742095
2015-03-13 10:11:17,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0024_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005.tokens
2015-03-13 10:11:17,228 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,328 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0024_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004.tokens
2015-03-13 10:11:17,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,562 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,569 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:17,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0024_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002.tokens
2015-03-13 10:11:17,702 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:17,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:17,962 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,564 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,848 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,849 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:18,967 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,569 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,853 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:19,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,575 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,857 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:20,970 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,580 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:21,974 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,582 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,860 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,860 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:22,975 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,587 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,861 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,862 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:23,980 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:24,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:24,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:24,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:24,258 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62874, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 152000
2015-03-13 10:11:24,338 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job.split dst=null perm=null
2015-03-13 10:11:24,375 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62876, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 176000
2015-03-13 10:11:24,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62878, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 142000
2015-03-13 10:11:24,419 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62879, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 162000
2015-03-13 10:11:24,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:24,436 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62880, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:11:24,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:24,497 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62882, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:11:24,504 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62881, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742109_1285, duration: 168000
2015-03-13 10:11:24,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:24,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:24,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,545 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62879, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 131000
2015-03-13 10:11:24,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,589 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:24,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62883, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 150000
2015-03-13 10:11:24,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:24,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,867 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:24,906 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:24,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:24,914 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62874, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:11:24,954 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:24,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:24,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:24,996 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62884 dest: /127.0.0.1:60696
2015-03-13 10:11:24,996 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:24,998 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62885 dest: /127.0.0.1:60689
2015-03-13 10:11:24,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289 src: /127.0.0.1:62886 dest: /127.0.0.1:60693
2015-03-13 10:11:25,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,010 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62886, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 9559000
2015-03-13 10:11:25,010 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,011 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62885, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 10294000
2015-03-13 10:11:25,011 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,011 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,012 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62884, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 10972000
2015-03-13 10:11:25,012 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,012 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742113_1289{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,014 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62876, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 115000
2015-03-13 10:11:25,016 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0024_m_000001_0_1865062451_1
2015-03-13 10:11:25,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0 dst=null perm=null
2015-03-13 10:11:25,029 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62887, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:11:25,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0 dst=null perm=null
2015-03-13 10:11:25,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001 dst=null perm=null
2015-03-13 10:11:25,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62878, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:11:25,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000001_0 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,042 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,046 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,058 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,058 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000003
2015-03-13 10:11:25,058 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,058 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,071 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000003 is : 143
2015-03-13 10:11:25,073 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:25,074 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62889 dest: /127.0.0.1:60689
2015-03-13 10:11:25,076 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62890 dest: /127.0.0.1:60686
2015-03-13 10:11:25,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291 src: /127.0.0.1:62891 dest: /127.0.0.1:60693
2015-03-13 10:11:25,081 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist for DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,083 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,083 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,084 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000003 from application application_1426266260362_0024
2015-03-13 10:11:25,084 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,084 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,084 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000003
2015-03-13 10:11:25,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,092 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:25,096 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62892, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 161000
2015-03-13 10:11:25,110 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62888 dest: /127.0.0.1:60689
2015-03-13 10:11:25,111 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62893 dest: /127.0.0.1:60696
2015-03-13 10:11:25,113 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290 src: /127.0.0.1:62894 dest: /127.0.0.1:60686
2015-03-13 10:11:25,113 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:25,123 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62894, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 8646000
2015-03-13 10:11:25,123 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,123 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,124 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62893, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 9375000
2015-03-13 10:11:25,124 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,124 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,124 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62888, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 10169000
2015-03-13 10:11:25,125 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,125 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742114_1290{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,130 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0024_m_000003_0_312247103_1
2015-03-13 10:11:25,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0 dst=null perm=null
2015-03-13 10:11:25,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0 dst=null perm=null
2015-03-13 10:11:25,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003 dst=null perm=null
2015-03-13 10:11:25,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000003_0 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62895 dest: /127.0.0.1:60693
2015-03-13 10:11:25,162 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62896 dest: /127.0.0.1:60689
2015-03-13 10:11:25,163 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292 src: /127.0.0.1:62897 dest: /127.0.0.1:60696
2015-03-13 10:11:25,165 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,165 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000005
2015-03-13 10:11:25,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,165 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000003
2015-03-13 10:11:25,166 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,166 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,166 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,166 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,166 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000003
2015-03-13 10:11:25,166 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:25,166 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:25,167 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,167 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,167 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:25,167 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:25,178 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000005 is : 143
2015-03-13 10:11:25,189 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62897, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 24150000
2015-03-13 10:11:25,189 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,190 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,190 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62896, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 24304000
2015-03-13 10:11:25,190 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,191 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,191 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62895, dest: /127.0.0.1:60693, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 25629000
2015-03-13 10:11:25,191 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,192 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,192 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742116_1292{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:25,196 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,197 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,197 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000005
2015-03-13 10:11:25,198 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,198 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,198 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000005 from application application_1426266260362_0024
2015-03-13 10:11:25,199 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,199 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,204 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0024_m_000000_0_-988689571_1
2015-03-13 10:11:25,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0 dst=null perm=null
2015-03-13 10:11:25,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0 dst=null perm=null
2015-03-13 10:11:25,226 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000 dst=null perm=null
2015-03-13 10:11:25,230 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000000_0 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,242 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62898 dest: /127.0.0.1:60696
2015-03-13 10:11:25,244 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62899 dest: /127.0.0.1:60689
2015-03-13 10:11:25,245 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293 src: /127.0.0.1:62900 dest: /127.0.0.1:60686
2015-03-13 10:11:25,246 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000002
2015-03-13 10:11:25,246 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,246 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,246 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000002
2015-03-13 10:11:25,247 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,247 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,247 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,247 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000005
2015-03-13 10:11:25,247 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,248 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,248 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000005
2015-03-13 10:11:25,248 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:25,248 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:25,248 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,248 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,248 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:25,248 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000005 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:25,260 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000002 is : 143
2015-03-13 10:11:25,272 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,272 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,272 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,273 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,273 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000002
2015-03-13 10:11:25,274 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,274 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,274 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000002 from application application_1426266260362_0024
2015-03-13 10:11:25,274 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,275 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,281 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62900, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 33432000
2015-03-13 10:11:25,281 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,282 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62899, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 34136000
2015-03-13 10:11:25,282 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,283 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,283 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62898, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 35197000
2015-03-13 10:11:25,283 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742117_1293{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,291 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0024_m_000002_0_-687252152_1
2015-03-13 10:11:25,300 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0 dst=null perm=null
2015-03-13 10:11:25,306 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0 dst=null perm=null
2015-03-13 10:11:25,307 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002 dst=null perm=null
2015-03-13 10:11:25,310 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000002_0 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,320 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000004
2015-03-13 10:11:25,320 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:25,320 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:25,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000002
2015-03-13 10:11:25,321 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000004
2015-03-13 10:11:25,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,322 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:25,322 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:25,322 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000002
2015-03-13 10:11:25,322 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:25,322 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:25,322 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,322 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:25,322 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:25,322 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000002 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:25,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,334 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000004 is : 143
2015-03-13 10:11:25,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:25,342 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62881, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 153000
2015-03-13 10:11:25,345 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,346 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:25,346 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,347 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000004 from application application_1426266260362_0024
2015-03-13 10:11:25,347 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,347 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,366 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,401 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62901 dest: /127.0.0.1:60696
2015-03-13 10:11:25,402 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62902 dest: /127.0.0.1:60693
2015-03-13 10:11:25,404 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294 src: /127.0.0.1:62903 dest: /127.0.0.1:60686
2015-03-13 10:11:25,411 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62903, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 6082000
2015-03-13 10:11:25,412 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,412 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,412 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62902, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 6858000
2015-03-13 10:11:25,412 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,413 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,413 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62901, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 7580000
2015-03-13 10:11:25,413 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,413 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742118_1294{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,417 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0024_m_000004_0_-1004890562_1
2015-03-13 10:11:25,426 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0 dst=null perm=null
2015-03-13 10:11:25,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0 dst=null perm=null
2015-03-13 10:11:25,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004 dst=null perm=null
2015-03-13 10:11:25,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/_temporary/attempt_1426266260362_0024_m_000004_0 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:25,448 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000006
2015-03-13 10:11:25,448 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:25,448 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:25,449 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000006
2015-03-13 10:11:25,449 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:25,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,455 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1 dst=null perm=null
2015-03-13 10:11:25,462 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0024_01_000006 is : 143
2015-03-13 10:11:25,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000 dst=null perm=null
2015-03-13 10:11:25,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:25,473 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:25,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000000/part-00000 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,474 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,474 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,474 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:25,475 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:25,475 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000006 from application application_1426266260362_0024
2015-03-13 10:11:25,475 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:25,475 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:25,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001 dst=null perm=null
2015-03-13 10:11:25,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:25,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000001/part-00001 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002 dst=null perm=null
2015-03-13 10:11:25,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:25,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000002/part-00002 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003 dst=null perm=null
2015-03-13 10:11:25,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:25,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000003/part-00003 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:25,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004 dst=null perm=null
2015-03-13 10:11:25,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:25,498 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary/1/task_1426266260362_0024_m_000004/part-00004 dst=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,501 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_temporary dst=null perm=null
2015-03-13 10:11:25,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,507 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,512 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,526 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62891, dest: /127.0.0.1:60693, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 447659000
2015-03-13 10:11:25,526 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,527 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,528 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62890, dest: /127.0.0.1:60686, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 448945000
2015-03-13 10:11:25,528 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,529 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,529 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62889, dest: /127.0.0.1:60689, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 450345000
2015-03-13 10:11:25,529 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,530 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742115_1291{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:25,532 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,536 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:25,538 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62904 dest: /127.0.0.1:60696
2015-03-13 10:11:25,539 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62905 dest: /127.0.0.1:60693
2015-03-13 10:11:25,540 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295 src: /127.0.0.1:62906 dest: /127.0.0.1:60689
2015-03-13 10:11:25,543 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62906, dest: /127.0.0.1:60689, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 1344000
2015-03-13 10:11:25,543 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,544 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62905, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 1755000
2015-03-13 10:11:25,544 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,544 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,544 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62904, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 2558000
2015-03-13 10:11:25,545 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,545 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,546 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742119_1295{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:25,549 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist dst=null perm=null
2015-03-13 10:11:25,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:25,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist dst=null perm=null
2015-03-13 10:11:25,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:25,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1.jhist dst=null perm=null
2015-03-13 10:11:25,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,569 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62907, bytes: 53745, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291, duration: 177000
2015-03-13 10:11:25,571 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,573 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62908 dest: /127.0.0.1:60696
2015-03-13 10:11:25,575 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62909 dest: /127.0.0.1:60689
2015-03-13 10:11:25,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296 src: /127.0.0.1:62910 dest: /127.0.0.1:60686
2015-03-13 10:11:25,579 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62910, dest: /127.0.0.1:60686, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 1672000
2015-03-13 10:11:25,579 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,580 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62909, dest: /127.0.0.1:60689, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 2207000
2015-03-13 10:11:25,580 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,580 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,581 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62908, dest: /127.0.0.1:60696, bytes: 53325, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, duration: 3023000
2015-03-13 10:11:25,581 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,581 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742120_1296{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,583 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml dst=null perm=null
2015-03-13 10:11:25,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:25,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml dst=null perm=null
2015-03-13 10:11:25,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:25,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024/job_1426266260362_0024_1_conf.xml dst=null perm=null
2015-03-13 10:11:25,591 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:25,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:25,593 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62911, bytes: 91488, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742112_1288, duration: 277000
2015-03-13 10:11:25,595 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:25,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62912 dest: /127.0.0.1:60696
2015-03-13 10:11:25,597 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62913 dest: /127.0.0.1:60689
2015-03-13 10:11:25,598 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297 src: /127.0.0.1:62914 dest: /127.0.0.1:60686
2015-03-13 10:11:25,601 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62914, dest: /127.0.0.1:60686, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 1727000
2015-03-13 10:11:25,601 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:25,602 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,602 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62913, dest: /127.0.0.1:60689, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 2256000
2015-03-13 10:11:25,602 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,602 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,602 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62912, dest: /127.0.0.1:60696, bytes: 90776, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1654895269_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, duration: 2967000
2015-03-13 10:11:25,603 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:25,603 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742121_1297{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:25,605 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1654895269_1
2015-03-13 10:11:25,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,610 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:25,619 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:25,619 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0024
2015-03-13 10:11:25,619 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from RUNNING to REMOVING
2015-03-13 10:11:25,619 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0024
2015-03-13 10:11:25,619 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from REMOVING to FINISHING
2015-03-13 10:11:26,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:26,327 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000004
2015-03-13 10:11:26,328 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:26,328 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:26,328 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000004
2015-03-13 10:11:26,328 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:26,328 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:26,329 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,329 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,329 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:26,329 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:26,454 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:26,454 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000006
2015-03-13 10:11:26,455 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:26,455 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:26,455 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000006
2015-03-13 10:11:26,455 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:26,455 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:26,456 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,456 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:26,456 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:26,456 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:26,592 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:26,626 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742108_1284 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:26,626 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742109_1285 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:11:26,626 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742110_1286 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:26,626 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742111_1287 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:26,627 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742115_1291 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:11:26,627 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742112_1288 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:11:26,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0024 dst=null perm=null
2015-03-13 10:11:26,652 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] starting step: (1/2) ...orm/joinaroundjoinswapped
2015-03-13 10:11:26,659 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,666 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:26,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:26,669 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:26,671 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 25
2015-03-13 10:11:26,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=null
2015-03-13 10:11:26,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:26,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:11:26,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:26,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,676 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62917 dest: /127.0.0.1:60696
2015-03-13 10:11:26,679 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62918 dest: /127.0.0.1:60686
2015-03-13 10:11:26,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62919 dest: /127.0.0.1:60689
2015-03-13 10:11:26,683 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62919, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 2776000
2015-03-13 10:11:26,684 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,684 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62918, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 2493000
2015-03-13 10:11:26,684 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,684 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,684 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,685 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62917, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 3301000
2015-03-13 10:11:26,685 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,685 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742122_1298{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,688 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,689 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar
2015-03-13 10:11:26,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:26,690 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:26,691 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:26,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:26,692 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:11:26,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:11:26,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:11:26,693 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:11:26,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:11:26,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:26,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:26,696 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:26,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:26,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,699 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,699 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split
2015-03-13 10:11:26,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:26,701 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,702 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62920 dest: /127.0.0.1:60693
2015-03-13 10:11:26,703 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62921 dest: /127.0.0.1:60686
2015-03-13 10:11:26,704 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62922 dest: /127.0.0.1:60696
2015-03-13 10:11:26,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299 src: /127.0.0.1:62923 dest: /127.0.0.1:60689
2015-03-13 10:11:26,708 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62923, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 1520000
2015-03-13 10:11:26,708 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,709 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,709 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62922, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 1632000
2015-03-13 10:11:26,709 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,709 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,709 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62921, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 2577000
2015-03-13 10:11:26,710 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,710 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,710 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62920, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 3460000
2015-03-13 10:11:26,710 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,711 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742123_1299{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,712 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,716 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:26,717 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62924 dest: /127.0.0.1:60693
2015-03-13 10:11:26,719 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62925 dest: /127.0.0.1:60696
2015-03-13 10:11:26,720 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300 src: /127.0.0.1:62926 dest: /127.0.0.1:60689
2015-03-13 10:11:26,723 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62926, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 1149000
2015-03-13 10:11:26,723 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,723 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,723 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62925, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 1517000
2015-03-13 10:11:26,723 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,724 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,724 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62924, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 2331000
2015-03-13 10:11:26,724 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,725 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742124_1300{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:26,726 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,726 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:26,728 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:26,730 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:26,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:26,731 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:26,734 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:26,735 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62927 dest: /127.0.0.1:60693
2015-03-13 10:11:26,736 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62928 dest: /127.0.0.1:60686
2015-03-13 10:11:26,737 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301 src: /127.0.0.1:62929 dest: /127.0.0.1:60696
2015-03-13 10:11:26,740 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62929, dest: /127.0.0.1:60696, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 2117000
2015-03-13 10:11:26,740 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:26,741 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,741 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62928, dest: /127.0.0.1:60686, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 1790000
2015-03-13 10:11:26,741 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,741 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,741 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62927, dest: /127.0.0.1:60693, bytes: 98230, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 2363000
2015-03-13 10:11:26,742 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:26,742 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742125_1301{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:26,743 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:26,743 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0025
2015-03-13 10:11:26,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=null
2015-03-13 10:11:26,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:26,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:26,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:26,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:26,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:26,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:26,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:26,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:26,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:26,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:26,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:26,752 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 25 submitted by user soberoi
2015-03-13 10:11:26,752 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0025
2015-03-13 10:11:26,752 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0025
2015-03-13 10:11:26,752 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0025
2015-03-13 10:11:26,752 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from NEW to NEW_SAVING
2015-03-13 10:11:26,753 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:26,753 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0025_000001
2015-03-13 10:11:26,753 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:26,753 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0025 from user: soberoi activated in queue: default
2015-03-13 10:11:26,753 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0025 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:26,753 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0025 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:26,753 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0025_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:26,753 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0025 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:26,754 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:26,754 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:26,756 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0025/
2015-03-13 10:11:26,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] submitted hadoop job: job_1426266260362_0025
2015-03-13 10:11:26,756 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [upper2*lower*upper1] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0025/
2015-03-13 10:11:27,018 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:27,018 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:27,018 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:27,018 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0025_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:27,019 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:27,019 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:27,019 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:27,020 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0025 AttemptId: appattempt_1426266260362_0025_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:11:27,020 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:27,020 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,020 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:27,020 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0025_000001
2015-03-13 10:11:27,021 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,021 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0025_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:11:27,023 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:27,024 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000001 by user soberoi
2015-03-13 10:11:27,024 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:27,024 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:27,025 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:27,025 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000001 to application application_1426266260362_0025
2015-03-13 10:11:27,025 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:27,025 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0025_000001
2015-03-13 10:11:27,025 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:27,025 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:27,025 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:27,025 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:27,026 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000001
2015-03-13 10:11:27,035 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0025_01_000001.tokens. Credentials list:
2015-03-13 10:11:27,050 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:27,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0025_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001.tokens
2015-03-13 10:11:27,121 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:27,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:27,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:27,179 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:27,186 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 426000
2015-03-13 10:11:27,204 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:27,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:27,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:27,227 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 173000
2015-03-13 10:11:27,238 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:27,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:27,255 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:27,262 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62934, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 147000
2015-03-13 10:11:27,276 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:27,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:27,293 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:27,298 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62933, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-912891646_13263, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 252000
2015-03-13 10:11:27,311 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:27,311 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:27,335 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:27,346 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:27,414 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001/default_container_executor.sh]
2015-03-13 10:11:27,598 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,008 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742122_1298 to datanode(s) 127.0.0.1:60693
2015-03-13 10:11:28,009 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286]
2015-03-13 10:11:28,009 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286, blk_1073742111_1287]
2015-03-13 10:11:28,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,018 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:28,592 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 to 127.0.0.1:60693
2015-03-13 10:11:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:28,593 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:28,592 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:28,594 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:28,594 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62935 dest: /127.0.0.1:60693
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:28,594 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:28,595 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:28,595 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:28,595 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:28,595 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:28,596 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298 src: /127.0.0.1:62935 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:11:28,596 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742122_1298 size 254067
2015-03-13 10:11:28,603 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:28,974 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:28,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED dst=null perm=null
2015-03-13 10:11:28,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:11:29,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_FAIL dst=null perm=null
2015-03-13 10:11:29,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:29,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=null
2015-03-13 10:11:29,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:11:29,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:11:29,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:29,334 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:29,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:29,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62937, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300, duration: 134000
2015-03-13 10:11:29,540 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,540 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:29,541 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:29,541 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:29,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:29,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:29,542 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:29,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:29,543 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:29,608 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:29,894 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:29,894 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:29,894 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:29,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:29,896 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,945 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:29,946 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:29,946 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:29,947 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:30,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:30,094 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742124_1300
2015-03-13 10:11:30,095 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:30,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:30,096 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742121_1297
2015-03-13 10:11:30,097 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:30,134 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:30,136 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0025_000001
2015-03-13 10:11:30,136 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0025 APPATTEMPTID=appattempt_1426266260362_0025_000001
2015-03-13 10:11:30,136 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:30,136 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from ACCEPTED to RUNNING
2015-03-13 10:11:30,146 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742115_1291
2015-03-13 10:11:30,147 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:30,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289
2015-03-13 10:11:30,148 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292
2015-03-13 10:11:30,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:30,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:30,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:30,301 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301
2015-03-13 10:11:30,339 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:30,384 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62943 dest: /127.0.0.1:60689
2015-03-13 10:11:30,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62944 dest: /127.0.0.1:60693
2015-03-13 10:11:30,387 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302 src: /127.0.0.1:62945 dest: /127.0.0.1:60696
2015-03-13 10:11:30,395 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62945, dest: /127.0.0.1:60696, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 6460000
2015-03-13 10:11:30,395 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:30,395 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,396 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62944, dest: /127.0.0.1:60693, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 7434000
2015-03-13 10:11:30,396 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:30,396 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,396 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62943, dest: /127.0.0.1:60689, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 8265000
2015-03-13 10:11:30,397 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:30,397 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742126_1302{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:30,401 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:30,501 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298
2015-03-13 10:11:30,501 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299
2015-03-13 10:11:30,502 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742120_1296
2015-03-13 10:11:30,502 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:30,502 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290
2015-03-13 10:11:30,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295
2015-03-13 10:11:30,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293
2015-03-13 10:11:30,503 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294
2015-03-13 10:11:30,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,013 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742112_1288, blk_1073742115_1291, blk_1073742108_1284, blk_1073742109_1285, blk_1073742111_1287]
2015-03-13 10:11:31,013 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742108_1284, blk_1073742109_1285, blk_1073742110_1286, blk_1073742111_1287]
2015-03-13 10:11:31,024 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,339 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,339 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:31,339 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:31,340 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,340 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:31,340 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,340 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,341 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:31,341 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:31,341 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,341 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:31,341 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,342 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,342 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:31,342 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:31,342 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,342 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:31,343 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,343 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,343 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:31,343 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:11:31,343 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0025_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,343 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:31,343 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,469 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:31,469 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:31,469 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:31,469 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0025 container=Container: [ContainerId: container_1426266260362_0025_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0025_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,470 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:31,470 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:31,615 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:31,657 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0024_01_000001 succeeded
2015-03-13 10:11:31,657 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:31,657 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024/container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:31,669 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0024_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:31,669 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0024_01_000001 from application application_1426266260362_0024
2015-03-13 10:11:31,669 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:31,669 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0024
2015-03-13 10:11:31,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112 for deletion
2015-03-13 10:11:31,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115 for deletion
2015-03-13 10:11:31,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:31,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742112_1288 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742112
2015-03-13 10:11:31,810 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:31,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:31,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742115_1291 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742115
2015-03-13 10:11:31,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:31,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:31,811 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:31,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108 for deletion
2015-03-13 10:11:31,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109 for deletion
2015-03-13 10:11:31,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110 for deletion
2015-03-13 10:11:31,988 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111 for deletion
2015-03-13 10:11:31,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742108_1284 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742108
2015-03-13 10:11:31,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742109_1285 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742109
2015-03-13 10:11:31,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742110_1286 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742110
2015-03-13 10:11:31,989 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742111_1287 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742111
2015-03-13 10:11:32,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,171 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,172 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,172 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:32,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:32,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:32,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:32,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:32,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:32,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:32,292 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:32,292 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:32,296 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000003 by user soberoi
2015-03-13 10:11:32,296 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:32,296 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000004 by user soberoi
2015-03-13 10:11:32,296 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:32,297 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000002 by user soberoi
2015-03-13 10:11:32,297 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:32,297 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000003 to application application_1426266260362_0025
2015-03-13 10:11:32,297 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000004 to application application_1426266260362_0025
2015-03-13 10:11:32,297 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000005 by user soberoi
2015-03-13 10:11:32,297 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:32,297 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:32,297 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,297 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,297 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000005 to application application_1426266260362_0025
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,298 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,298 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,296 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0025_01_000006 by user soberoi
2015-03-13 10:11:32,299 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0025
2015-03-13 10:11:32,299 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:32,298 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,300 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from NEW to INITING
2015-03-13 10:11:32,300 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000006 to application application_1426266260362_0025
2015-03-13 10:11:32,300 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from INITING to RUNNING
2015-03-13 10:11:32,298 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:32,300 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,300 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,300 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,300 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,300 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,301 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,301 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:32,301 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000006
2015-03-13 10:11:32,296 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:32,300 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0025_01_000002 to application application_1426266260362_0025
2015-03-13 10:11:32,302 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,302 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000004
2015-03-13 10:11:32,302 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000003
2015-03-13 10:11:32,303 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:32,303 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,303 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,303 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,303 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,303 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,304 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0025
2015-03-13 10:11:32,304 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:32,304 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0025
2015-03-13 10:11:32,304 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000005
2015-03-13 10:11:32,304 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0025_01_000002
2015-03-13 10:11:32,327 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0025_01_000006.tokens. Credentials list:
2015-03-13 10:11:32,327 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000002.tokens. Credentials list:
2015-03-13 10:11:32,328 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000003.tokens. Credentials list:
2015-03-13 10:11:32,328 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000005.tokens. Credentials list:
2015-03-13 10:11:32,329 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000004.tokens. Credentials list:
2015-03-13 10:11:32,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,340 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,340 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,340 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,341 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:32,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:32,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002.tokens
2015-03-13 10:11:32,423 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:32,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0025_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006.tokens
2015-03-13 10:11:32,424 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:32,469 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:32,469 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:32,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,494 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar dst=null perm=null
2015-03-13 10:11:32,501 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62953, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_235292084_13409, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 432000
2015-03-13 10:11:32,501 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62952, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_647090437_13410, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742122_1298, duration: 487000
2015-03-13 10:11:32,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,522 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,541 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml dst=null perm=null
2015-03-13 10:11:32,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62952, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_235292084_13409, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 252000
2015-03-13 10:11:32,548 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62954, bytes: 98998, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_647090437_13410, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742125_1301, duration: 232000
2015-03-13 10:11:32,562 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:32,562 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:32,610 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,610 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,611 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,611 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,612 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,612 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,612 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,612 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,615 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 24 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:32,616 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0024_01_000001
2015-03-13 10:11:32,617 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0024_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:32,618 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0024_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:32,618 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0024 CONTAINERID=container_1426266260362_0024_01_000001
2015-03-13 10:11:32,619 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0024_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:32,619 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:32,619 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0024_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:32,619 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:32,619 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:32,619 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0024_000001 released container container_1426266260362_0024_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:32,619 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0024_000001
2015-03-13 10:11:32,619 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0024_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:32,619 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0024 State change from FINISHING to FINISHED
2015-03-13 10:11:32,619 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0024
2015-03-13 10:11:32,620 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0024,name=[716001CDD2B94A3FADE59C5DF8875A2D/4BC832EC1D1E4858AE3D38200A23E3C1] upper2*lower*upper1/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0024/jobhistory/job/job_1426266260362_0024,appMasterHost=Edinburgh.local,startTime=1426266670375,finishTime=1426266685619,finalStatus=SUCCEEDED
2015-03-13 10:11:32,619 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:32,620 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:32,620 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0024_000001 is done. finalState=FINISHED
2015-03-13 10:11:32,620 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0024 requests cleared
2015-03-13 10:11:32,620 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0024 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:32,620 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0024 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:32,620 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0024_000001
2015-03-13 10:11:32,624 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0024_000001 (auth:SIMPLE)
2015-03-13 10:11:32,627 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0024_01_000001
2015-03-13 10:11:32,750 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006/default_container_executor.sh]
2015-03-13 10:11:32,757 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005/default_container_executor.sh]
2015-03-13 10:11:32,769 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002/default_container_executor.sh]
2015-03-13 10:11:32,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004/default_container_executor.sh]
2015-03-13 10:11:32,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003/default_container_executor.sh]
2015-03-13 10:11:33,029 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,184 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:11:33,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,344 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,345 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,345 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,345 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:33,470 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,470 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,471 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,471 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,470 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:33,616 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:33,616 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,617 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,618 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0024
2015-03-13 10:11:33,618 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0024
2015-03-13 10:11:33,618 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0024 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:33,618 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0024, with delay of 10800 seconds
2015-03-13 10:11:33,744 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004.tokens
2015-03-13 10:11:33,744 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:33,852 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:33,967 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0025_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005.tokens
2015-03-13 10:11:33,968 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:34,031 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,059 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:34,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0025_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003.tokens
2015-03-13 10:11:34,185 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:34,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:34,551 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:35,037 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,153 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302
2015-03-13 10:11:35,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:35,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,041 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,353 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:36,476 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,359 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:37,478 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,051 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:38,481 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,056 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:39,487 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,059 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,369 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:40,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:40,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:40,877 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:40,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:40,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job.split dst=null perm=null
2015-03-13 10:11:40,975 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 138000
2015-03-13 10:11:41,002 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 156000
2015-03-13 10:11:41,044 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62972, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 150000
2015-03-13 10:11:41,049 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62973, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 151000
2015-03-13 10:11:41,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62974, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742123_1299, duration: 147000
2015-03-13 10:11:41,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:41,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:41,129 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62975, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:11:41,152 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2545 Total time for transactions(ms): 118 Number of transactions batched in Syncs: 5 Number of syncs: 1450 SyncTimes(ms): 416 325
2015-03-13 10:11:41,152 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:41,173 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62976, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 150000
2015-03-13 10:11:41,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:41,179 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62974, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 142000
2015-03-13 10:11:41,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:41,183 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62973, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 152000
2015-03-13 10:11:41,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:41,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,371 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,496 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,561 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,597 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,638 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,639 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,642 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 152000
2015-03-13 10:11:41,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,657 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 148000
2015-03-13 10:11:41,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,689 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,690 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62971, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 152000
2015-03-13 10:11:41,692 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62977, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 142000
2015-03-13 10:11:41,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,694 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,695 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,697 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:41,701 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 147000
2015-03-13 10:11:41,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,707 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 174000
2015-03-13 10:11:41,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,710 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 143000
2015-03-13 10:11:41,711 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,713 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62979, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 151000
2015-03-13 10:11:41,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,717 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62978, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 145000
2015-03-13 10:11:41,719 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62979, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 146000
2015-03-13 10:11:41,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,725 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62970, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 153000
2015-03-13 10:11:41,727 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 148000
2015-03-13 10:11:41,728 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:62981, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 183000
2015-03-13 10:11:41,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 145000
2015-03-13 10:11:41,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,744 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62982, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 152000
2015-03-13 10:11:41,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,747 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,750 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62980, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 148000
2015-03-13 10:11:41,754 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,779 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62985, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 147000
2015-03-13 10:11:41,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,785 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00000 dst=null perm=null
2015-03-13 10:11:41,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62986, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742116_1292, duration: 136000
2015-03-13 10:11:41,790 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62983 dest: /127.0.0.1:60686
2015-03-13 10:11:41,792 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62987 dest: /127.0.0.1:60689
2015-03-13 10:11:41,793 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303 src: /127.0.0.1:62988 dest: /127.0.0.1:60693
2015-03-13 10:11:41,801 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:41,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62984 dest: /127.0.0.1:60689
2015-03-13 10:11:41,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62989 dest: /127.0.0.1:60696
2015-03-13 10:11:41,806 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304 src: /127.0.0.1:62991 dest: /127.0.0.1:60693
2015-03-13 10:11:41,813 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62988, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 18544000
2015-03-13 10:11:41,814 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,814 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,814 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62987, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 19230000
2015-03-13 10:11:41,815 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,815 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,815 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62983, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 20165000
2015-03-13 10:11:41,815 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,816 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742127_1303{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,818 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62991, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 10144000
2015-03-13 10:11:41,818 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,818 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,818 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62989, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 10788000
2015-03-13 10:11:41,818 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,819 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,819 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62984, dest: /127.0.0.1:60689, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 11500000
2015-03-13 10:11:41,819 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,820 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742128_1304{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:41,824 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0025_m_000001_0_223962474_1
2015-03-13 10:11:41,825 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0025_m_000000_0_-1945362310_1
2015-03-13 10:11:41,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0 dst=null perm=null
2015-03-13 10:11:41,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0 dst=null perm=null
2015-03-13 10:11:41,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0 dst=null perm=null
2015-03-13 10:11:41,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001 dst=null perm=null
2015-03-13 10:11:41,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0 dst=null perm=null
2015-03-13 10:11:41,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000 dst=null perm=null
2015-03-13 10:11:41,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62990 dest: /127.0.0.1:60693
2015-03-13 10:11:41,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62992 dest: /127.0.0.1:60686
2015-03-13 10:11:41,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305 src: /127.0.0.1:62993 dest: /127.0.0.1:60689
2015-03-13 10:11:41,866 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62993, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 6107000
2015-03-13 10:11:41,866 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:41,866 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,867 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62992, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 7017000
2015-03-13 10:11:41,867 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,867 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62990, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 7792000
2015-03-13 10:11:41,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,868 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:41,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742129_1305{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:41,872 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,878 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,879 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000003
2015-03-13 10:11:41,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:41,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,886 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,891 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000003 is : 143
2015-03-13 10:11:41,892 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:41,894 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62994 dest: /127.0.0.1:60693
2015-03-13 10:11:41,896 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62995 dest: /127.0.0.1:60689
2015-03-13 10:11:41,897 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306 src: /127.0.0.1:62996 dest: /127.0.0.1:60686
2015-03-13 10:11:41,898 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000002
2015-03-13 10:11:41,898 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,898 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:11:41,899 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,899 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,902 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist for DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:41,903 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:41,904 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,904 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000002
2015-03-13 10:11:41,904 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,905 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000003
2015-03-13 10:11:41,911 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 307000
2015-03-13 10:11:41,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,917 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000002 is : 143
2015-03-13 10:11:41,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,922 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 139000
2015-03-13 10:11:41,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,927 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62986, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 134000
2015-03-13 10:11:41,929 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,929 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:41,929 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:41,929 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000003 from application application_1426266260362_0025
2015-03-13 10:11:41,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,929 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:41,929 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:41,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:41,930 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000002 from application application_1426266260362_0025
2015-03-13 10:11:41,930 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:41,930 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:41,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,930 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000002
2015-03-13 10:11:41,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,933 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62997, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 141000
2015-03-13 10:11:41,934 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0025_m_000002_0_-112740768_1
2015-03-13 10:11:41,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00001 dst=null perm=null
2015-03-13 10:11:41,939 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:62998, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742113_1289, duration: 152000
2015-03-13 10:11:41,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00002 dst=null perm=null
2015-03-13 10:11:41,944 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0 dst=null perm=null
2015-03-13 10:11:41,946 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:62999, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742117_1293, duration: 140000
2015-03-13 10:11:41,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00003 dst=null perm=null
2015-03-13 10:11:41,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0 dst=null perm=null
2015-03-13 10:11:41,957 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002 dst=null perm=null
2015-03-13 10:11:41,958 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:41,959 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63000, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742114_1290, duration: 136000
2015-03-13 10:11:41,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:41,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,965 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5/part-00004 dst=null perm=null
2015-03-13 10:11:41,967 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:62985, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742118_1294, duration: 146000
2015-03-13 10:11:41,976 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000004
2015-03-13 10:11:41,977 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:41,977 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:41,977 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:41,977 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000002
2015-03-13 10:11:41,978 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000004
2015-03-13 10:11:41,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:41,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000003
2015-03-13 10:11:41,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:41,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:41,978 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:41,978 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:41,979 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000002
2015-03-13 10:11:41,979 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:11:41,979 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:41,979 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,979 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,979 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:41,979 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:11:41,979 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:41,979 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:41,979 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000003
2015-03-13 10:11:41,979 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:41,979 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:41,980 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,980 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:41,980 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:41,980 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000003 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:41,991 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000004 is : 143
2015-03-13 10:11:42,003 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,004 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:42,006 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,006 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000004 from application application_1426266260362_0025
2015-03-13 10:11:42,007 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,007 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,010 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63001 dest: /127.0.0.1:60689
2015-03-13 10:11:42,012 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63002 dest: /127.0.0.1:60686
2015-03-13 10:11:42,013 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307 src: /127.0.0.1:63003 dest: /127.0.0.1:60693
2015-03-13 10:11:42,022 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63003, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 7423000
2015-03-13 10:11:42,022 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,022 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,023 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63002, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 8105000
2015-03-13 10:11:42,023 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,023 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63001, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 8944000
2015-03-13 10:11:42,024 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,024 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742131_1307{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:42,036 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0025_m_000004_0_78506124_1
2015-03-13 10:11:42,044 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0025_m_000003_0_484463544_1
2015-03-13 10:11:42,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0 dst=null perm=null
2015-03-13 10:11:42,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0 dst=null perm=null
2015-03-13 10:11:42,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0 dst=null perm=null
2015-03-13 10:11:42,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0 dst=null perm=null
2015-03-13 10:11:42,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004 dst=null perm=null
2015-03-13 10:11:42,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003 dst=null perm=null
2015-03-13 10:11:42,062 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:42,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:42,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/_temporary/attempt_1426266260362_0025_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:42,073 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000006
2015-03-13 10:11:42,073 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:42,073 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:42,073 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000006
2015-03-13 10:11:42,074 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:42,077 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000005
2015-03-13 10:11:42,077 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:42,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:42,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000004
2015-03-13 10:11:42,077 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:42,078 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000005
2015-03-13 10:11:42,078 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:42,078 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:42,078 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:42,079 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000004
2015-03-13 10:11:42,079 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:42,079 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:42,079 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:42,079 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:42,079 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:42,079 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000004 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:42,082 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,084 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,086 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000006 is : 143
2015-03-13 10:11:42,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1 dst=null perm=null
2015-03-13 10:11:42,094 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0025_01_000005 is : 143
2015-03-13 10:11:42,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,098 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000 dst=null perm=null
2015-03-13 10:11:42,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,106 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,107 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000006
2015-03-13 10:11:42,098 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:42,107 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,107 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000006 from application application_1426266260362_0025
2015-03-13 10:11:42,107 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,107 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2015-03-13 10:11:42,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,116 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001 dst=null perm=null
2015-03-13 10:11:42,118 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:42,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2015-03-13 10:11:42,118 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000005
2015-03-13 10:11:42,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,121 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:42,122 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:42,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,122 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000005 from application application_1426266260362_0025
2015-03-13 10:11:42,122 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:42,122 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:42,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002 dst=null perm=null
2015-03-13 10:11:42,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2015-03-13 10:11:42,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003 dst=null perm=null
2015-03-13 10:11:42,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2015-03-13 10:11:42,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,133 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:42,134 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004 dst=null perm=null
2015-03-13 10:11:42,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2015-03-13 10:11:42,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary/1/task_1426266260362_0025_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary dst=null perm=null
2015-03-13 10:11:42,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,144 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_SUCCESS is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,149 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,162 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62996, dest: /127.0.0.1:60686, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 262383000
2015-03-13 10:11:42,163 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62995, dest: /127.0.0.1:60689, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 263794000
2015-03-13 10:11:42,164 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,166 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:62994, dest: /127.0.0.1:60693, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 265500000
2015-03-13 10:11:42,166 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742130_1306{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,168 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,172 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:42,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63004 dest: /127.0.0.1:60689
2015-03-13 10:11:42,176 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63005 dest: /127.0.0.1:60693
2015-03-13 10:11:42,178 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308 src: /127.0.0.1:63006 dest: /127.0.0.1:60696
2015-03-13 10:11:42,181 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63006, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 1416000
2015-03-13 10:11:42,181 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,181 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,181 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63005, dest: /127.0.0.1:60693, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 2021000
2015-03-13 10:11:42,182 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,182 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,182 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63004, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 3074000
2015-03-13 10:11:42,183 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,183 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742132_1308{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,184 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist dst=null perm=null
2015-03-13 10:11:42,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:42,199 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist dst=null perm=null
2015-03-13 10:11:42,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:11:42,201 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1.jhist dst=null perm=null
2015-03-13 10:11:42,203 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,205 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63007, bytes: 53769, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306, duration: 184000
2015-03-13 10:11:42,207 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:11:42,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63008 dest: /127.0.0.1:60696
2015-03-13 10:11:42,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63009 dest: /127.0.0.1:60693
2015-03-13 10:11:42,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309 src: /127.0.0.1:63010 dest: /127.0.0.1:60686
2015-03-13 10:11:42,214 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63010, dest: /127.0.0.1:60686, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 1651000
2015-03-13 10:11:42,214 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,215 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63009, dest: /127.0.0.1:60693, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 1987000
2015-03-13 10:11:42,215 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,215 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,216 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63008, dest: /127.0.0.1:60696, bytes: 53349, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, duration: 3041000
2015-03-13 10:11:42,216 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,217 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,217 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742133_1309{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:11:42,218 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,219 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml dst=null perm=null
2015-03-13 10:11:42,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:42,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml dst=null perm=null
2015-03-13 10:11:42,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp dst=null perm=null
2015-03-13 10:11:42,225 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025/job_1426266260362_0025_1_conf.xml dst=null perm=null
2015-03-13 10:11:42,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:42,230 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63011, bytes: 91733, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742126_1302, duration: 229000
2015-03-13 10:11:42,232 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:42,233 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63012 dest: /127.0.0.1:60689
2015-03-13 10:11:42,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63013 dest: /127.0.0.1:60686
2015-03-13 10:11:42,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310 src: /127.0.0.1:63014 dest: /127.0.0.1:60696
2015-03-13 10:11:42,238 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63014, dest: /127.0.0.1:60696, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 1905000
2015-03-13 10:11:42,239 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:42,239 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,239 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63013, dest: /127.0.0.1:60686, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 2311000
2015-03-13 10:11:42,239 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,240 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63012, dest: /127.0.0.1:60689, bytes: 91021, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_1195153157_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, duration: 3372000
2015-03-13 10:11:42,241 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:42,242 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742134_1310{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:42,243 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_1195153157_1
2015-03-13 10:11:42,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:11:42,256 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from RUNNING to FINISHING
2015-03-13 10:11:42,256 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0025
2015-03-13 10:11:42,256 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from RUNNING to REMOVING
2015-03-13 10:11:42,256 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0025
2015-03-13 10:11:42,257 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from REMOVING to FINISHING
2015-03-13 10:11:43,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:43,078 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:43,079 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000006
2015-03-13 10:11:43,079 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:43,079 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:43,079 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000006
2015-03-13 10:11:43,080 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:43,080 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:43,080 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,080 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,080 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:43,080 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:43,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:43,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000005
2015-03-13 10:11:43,083 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:43,083 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:43,083 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000005
2015-03-13 10:11:43,083 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:43,083 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:43,083 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,083 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,084 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:43,084 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:43,264 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742122_1298 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:11:43,264 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742123_1299 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:11:43,264 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742124_1300 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:11:43,264 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742125_1301 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:11:43,265 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742130_1306 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:11:43,265 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742126_1302 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:11:43,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0025 dst=null perm=null
2015-03-13 10:11:43,303 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742116_1292 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:11:43,303 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742113_1289 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:11:43,303 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742117_1293 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:11:43,303 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742114_1290 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:11:43,303 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742118_1294 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:11:43,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/2174182477_lower_upper1_ED842073FB4E4D44B323461837345BA5 dst=null perm=null
2015-03-13 10:11:43,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,304 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary
2015-03-13 10:11:43,305 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/_temporary dst=null perm=null
2015-03-13 10:11:43,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,312 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,313 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,314 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,315 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,316 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:43,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2015-03-13 10:11:43,319 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 207000
2015-03-13 10:11:43,320 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2015-03-13 10:11:43,321 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 156000
2015-03-13 10:11:43,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2015-03-13 10:11:43,323 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 177000
2015-03-13 10:11:43,324 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2015-03-13 10:11:43,325 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 166000
2015-03-13 10:11:43,325 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2015-03-13 10:11:43,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,333 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,334 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,338 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:11:43,339 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2015-03-13 10:11:43,341 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 121000
2015-03-13 10:11:43,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2015-03-13 10:11:43,344 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 134000
2015-03-13 10:11:43,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2015-03-13 10:11:43,345 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 134000
2015-03-13 10:11:43,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2015-03-13 10:11:43,346 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 154000
2015-03-13 10:11:43,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2015-03-13 10:11:43,347 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped
2015-03-13 10:11:43,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,348 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,349 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped dst=null perm=null
2015-03-13 10:11:43,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2015-03-13 10:11:43,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00000 dst=null perm=null
2015-03-13 10:11:43,352 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304, duration: 233000
2015-03-13 10:11:43,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2015-03-13 10:11:43,353 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00001 dst=null perm=null
2015-03-13 10:11:43,354 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303, duration: 162000
2015-03-13 10:11:43,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2015-03-13 10:11:43,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00002 dst=null perm=null
2015-03-13 10:11:43,357 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305, duration: 141000
2015-03-13 10:11:43,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2015-03-13 10:11:43,358 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00003 dst=null perm=null
2015-03-13 10:11:43,359 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63016, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307, duration: 174000
2015-03-13 10:11:43,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2015-03-13 10:11:43,360 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinaroundjoinswapped/part-00004 dst=null perm=null
2015-03-13 10:11:43,361 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:11:43,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:43,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,374 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:11:43,374 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:11:43,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch"]
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 2
2015-03-13 10:11:43,390 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 2
2015-03-13 10:11:43,391 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (2/2)
2015-03-13 10:11:43,398 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,406 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:11:43,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:43,408 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:43,410 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 26
2015-03-13 10:11:43,411 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=null
2015-03-13 10:11:43,412 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:11:43,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:11:43,413 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,415 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,416 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:43,417 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63021 dest: /127.0.0.1:60686
2015-03-13 10:11:43,418 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63022 dest: /127.0.0.1:60693
2015-03-13 10:11:43,419 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63023 dest: /127.0.0.1:60696
2015-03-13 10:11:43,423 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63023, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 2584000
2015-03-13 10:11:43,424 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,424 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,424 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63022, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 2649000
2015-03-13 10:11:43,424 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,425 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63021, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 3505000
2015-03-13 10:11:43,425 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,425 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742135_1311{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,426 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,427 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar
2015-03-13 10:11:43,427 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,428 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,429 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:43,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:43,431 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:43,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:11:43,432 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:11:43,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:11:43,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:11:43,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:11:43,434 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:43,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:43,436 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:11:43,436 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:43,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,439 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split
2015-03-13 10:11:43,440 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,441 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:11:43,442 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63024 dest: /127.0.0.1:60693
2015-03-13 10:11:43,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63025 dest: /127.0.0.1:60696
2015-03-13 10:11:43,444 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63026 dest: /127.0.0.1:60686
2015-03-13 10:11:43,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312 src: /127.0.0.1:63027 dest: /127.0.0.1:60689
2015-03-13 10:11:43,447 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63027, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 1602000
2015-03-13 10:11:43,448 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,448 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,448 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63026, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 1986000
2015-03-13 10:11:43,448 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63025, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 2802000
2015-03-13 10:11:43,449 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,450 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63024, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 3381000
2015-03-13 10:11:43,450 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,451 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742136_1312{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:11:43,452 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,455 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:43,456 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63028 dest: /127.0.0.1:60693
2015-03-13 10:11:43,457 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63029 dest: /127.0.0.1:60686
2015-03-13 10:11:43,458 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313 src: /127.0.0.1:63030 dest: /127.0.0.1:60696
2015-03-13 10:11:43,461 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63030, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 1048000
2015-03-13 10:11:43,461 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,461 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,461 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63029, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 1554000
2015-03-13 10:11:43,462 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,462 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,462 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63028, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 2462000
2015-03-13 10:11:43,463 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,464 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742137_1313{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:43,464 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,465 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:11:43,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:11:43,468 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:11:43,469 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:11:43,469 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:11:43,473 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:11:43,475 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63031 dest: /127.0.0.1:60686
2015-03-13 10:11:43,476 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63032 dest: /127.0.0.1:60696
2015-03-13 10:11:43,477 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314 src: /127.0.0.1:63033 dest: /127.0.0.1:60693
2015-03-13 10:11:43,480 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63033, dest: /127.0.0.1:60693, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 1418000
2015-03-13 10:11:43,480 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:43,481 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,481 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63032, dest: /127.0.0.1:60696, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 1965000
2015-03-13 10:11:43,481 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,481 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,482 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63031, dest: /127.0.0.1:60686, bytes: 97894, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 2743000
2015-03-13 10:11:43,482 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:43,482 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742138_1314{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:11:43,483 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:11:43,483 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0026
2015-03-13 10:11:43,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=null
2015-03-13 10:11:43,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:43,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:43,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:43,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:43,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:43,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:43,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:43,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:43,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:43,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:43,493 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 26 submitted by user soberoi
2015-03-13 10:11:43,493 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0026
2015-03-13 10:11:43,493 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0026
2015-03-13 10:11:43,493 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0026
2015-03-13 10:11:43,493 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from NEW to NEW_SAVING
2015-03-13 10:11:43,493 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:11:43,494 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,494 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from NEW to SUBMITTED
2015-03-13 10:11:43,494 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0026 from user: soberoi activated in queue: default
2015-03-13 10:11:43,494 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0026 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:11:43,494 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0026 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:11:43,494 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0026 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:11:43,494 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0026_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:11:43,494 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:11:43,495 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from SUBMITTED to ACCEPTED
2015-03-13 10:11:43,496 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0026/
2015-03-13 10:11:43,496 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0026
2015-03-13 10:11:43,496 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0026/
2015-03-13 10:11:43,638 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:43,638 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:11:43,638 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:11:43,638 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0026_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,639 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:11:43,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:43,639 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:43,639 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0026 AttemptId: appattempt_1426266260362_0026_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:11:43,639 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:11:43,640 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:11:43,640 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,640 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0026_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:11:43,642 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:43,643 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000001 by user soberoi
2015-03-13 10:11:43,643 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:43,643 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:11:43,644 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:43,644 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000001 to application application_1426266260362_0026
2015-03-13 10:11:43,644 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0026_000001
2015-03-13 10:11:43,644 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:43,644 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:11:43,644 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:11:43,644 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:43,644 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,644 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:43,645 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000001
2015-03-13 10:11:43,654 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0026_01_000001.tokens. Credentials list:
2015-03-13 10:11:43,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:43,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0026_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001.tokens
2015-03-13 10:11:43,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:43,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:43,806 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63017, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 495000
2015-03-13 10:11:43,825 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:43,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:43,842 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:43,848 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 164000
2015-03-13 10:11:43,861 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,879 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:43,885 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63018, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 150000
2015-03-13 10:11:43,896 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:43,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:43,913 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:43,919 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63019, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-878695311_13821, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 279000
2015-03-13 10:11:43,931 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:43,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:43,955 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:43,955 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:44,030 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001/default_container_executor.sh]
2015-03-13 10:11:44,069 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:44,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:44,561 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:44,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:44,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:44,562 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:44,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:44,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:44,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:44,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:44,638 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:45,070 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:45,166 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,166 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:45,167 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:45,167 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,168 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:45,168 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:45,168 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:45,312 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742130_1306
2015-03-13 10:11:45,313 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742131_1307
2015-03-13 10:11:45,313 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:45,314 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,314 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,370 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,370 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742129_1305
2015-03-13 10:11:45,371 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:45,515 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,516 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742134_1310
2015-03-13 10:11:45,516 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313
2015-03-13 10:11:45,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314
2015-03-13 10:11:45,517 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742133_1309
2015-03-13 10:11:45,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742127_1303
2015-03-13 10:11:45,518 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:11:45,641 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:45,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED dst=null perm=null
2015-03-13 10:11:45,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:11:45,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_FAIL dst=null perm=null
2015-03-13 10:11:45,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=null
2015-03-13 10:11:45,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:11:45,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:11:45,920 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:45,920 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742128_1304
2015-03-13 10:11:45,920 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312
2015-03-13 10:11:45,921 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308
2015-03-13 10:11:45,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:45,993 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.splitmetainfo dst=null perm=null
2015-03-13 10:11:46,021 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742135_1311 to datanode(s) 127.0.0.1:60689
2015-03-13 10:11:46,021 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742114_1290, blk_1073742130_1306, blk_1073742117_1293, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742125_1301]
2015-03-13 10:11:46,021 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742113_1289, blk_1073742114_1290, blk_1073742116_1292, blk_1073742117_1293, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302]
2015-03-13 10:11:46,050 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63038, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742137_1313, duration: 154000
2015-03-13 10:11:46,071 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:46,607 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:46,608 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:46,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:46,841 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:46,842 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0026_000001
2015-03-13 10:11:46,842 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0026 APPATTEMPTID=appattempt_1426266260362_0026_000001
2015-03-13 10:11:46,842 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:11:46,842 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from ACCEPTED to RUNNING
2015-03-13 10:11:46,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:46,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:11:46,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:11:46,995 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 to 127.0.0.1:60689
2015-03-13 10:11:46,995 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:46,995 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:46,996 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:46,997 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:46,997 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:46,998 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:46,997 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63044 dest: /127.0.0.1:60689
2015-03-13 10:11:46,999 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311 src: /127.0.0.1:63044 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:11:47,000 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742135_1311 size 254067
2015-03-13 10:11:47,051 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:47,075 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:47,086 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63045 dest: /127.0.0.1:60686
2015-03-13 10:11:47,088 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63046 dest: /127.0.0.1:60689
2015-03-13 10:11:47,089 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315 src: /127.0.0.1:63047 dest: /127.0.0.1:60696
2015-03-13 10:11:47,097 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63047, dest: /127.0.0.1:60696, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 5713000
2015-03-13 10:11:47,097 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:11:47,098 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63046, dest: /127.0.0.1:60689, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 6508000
2015-03-13 10:11:47,098 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:47,098 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,099 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63045, dest: /127.0.0.1:60686, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 8103000
2015-03-13 10:11:47,100 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:11:47,101 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,101 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742139_1315{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:11:47,105 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:11:47,652 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,077 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,078 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,078 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:48,079 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:11:48,079 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0026_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,079 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:11:48,079 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,080 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,080 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:48,080 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:11:48,080 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0026_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,080 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:11:48,081 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,091 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,091 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:48,091 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:11:48,091 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,091 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:11:48,092 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,092 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,092 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:48,092 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:11:48,092 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,093 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:11:48,093 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,093 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:11:48,093 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:48,093 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:11:48,093 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0026_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,094 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:11:48,094 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:48,393 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0025_01_000001 succeeded
2015-03-13 10:11:48,393 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:11:48,393 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0025/container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:48,400 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0025_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:11:48,401 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0025_01_000001 from application application_1426266260362_0025
2015-03-13 10:11:48,401 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:48,401 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0025
2015-03-13 10:11:48,657 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:48,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,875 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:11:48,901 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:48,902 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:48,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:48,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:48,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:48,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:48,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:48,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:48,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:11:48,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:11:48,997 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:48,997 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:11:49,000 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000004 by user soberoi
2015-03-13 10:11:49,001 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000003 by user soberoi
2015-03-13 10:11:49,001 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:49,001 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:49,001 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:11:49,001 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:49,001 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000002 by user soberoi
2015-03-13 10:11:49,002 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000006 by user soberoi
2015-03-13 10:11:49,002 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:49,002 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:49,001 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000005 by user soberoi
2015-03-13 10:11:49,002 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:49,002 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:49,002 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:11:49,002 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000003 to application application_1426266260362_0026
2015-03-13 10:11:49,002 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000002 to application application_1426266260362_0026
2015-03-13 10:11:49,003 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:49,003 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,003 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,003 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,003 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,003 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,003 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,003 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,003 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,004 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,004 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,004 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,004 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,002 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000004 to application application_1426266260362_0026
2015-03-13 10:11:49,004 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000006 to application application_1426266260362_0026
2015-03-13 10:11:49,004 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000002
2015-03-13 10:11:49,004 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000005 to application application_1426266260362_0026
2015-03-13 10:11:49,005 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:11:49,005 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000003
2015-03-13 10:11:49,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:11:49,005 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,005 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,005 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,005 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,005 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,006 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,006 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:11:49,006 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:11:49,006 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:11:49,006 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000006
2015-03-13 10:11:49,008 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000004
2015-03-13 10:11:49,008 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000005
2015-03-13 10:11:49,022 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742113_1289, blk_1073742130_1306, blk_1073742116_1292, blk_1073742118_1294, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742125_1301, blk_1073742126_1302]
2015-03-13 10:11:49,022 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742113_1289, blk_1073742114_1290, blk_1073742130_1306, blk_1073742116_1292, blk_1073742117_1293, blk_1073742122_1298, blk_1073742123_1299, blk_1073742124_1300, blk_1073742126_1302]
2015-03-13 10:11:49,030 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0026_01_000002.tokens. Credentials list:
2015-03-13 10:11:49,030 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0026_01_000006.tokens. Credentials list:
2015-03-13 10:11:49,031 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0026_01_000005.tokens. Credentials list:
2015-03-13 10:11:49,031 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0026_01_000003.tokens. Credentials list:
2015-03-13 10:11:49,031 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0026_01_000004.tokens. Credentials list:
2015-03-13 10:11:49,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:49,048 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:49,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 25 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:11:49,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0025_01_000001
2015-03-13 10:11:49,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,082 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,083 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,083 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,083 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0025_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:49,083 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0025_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:11:49,083 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0025 CONTAINERID=container_1426266260362_0025_01_000001
2015-03-13 10:11:49,083 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0025_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:49,083 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:11:49,084 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0025_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:49,084 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:49,084 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:11:49,084 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0025_000001 released container container_1426266260362_0025_01_000001 on node: host: 10.1.1.144:60723 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:49,083 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0025_000001
2015-03-13 10:11:49,084 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0025_000001 State change from FINISHING to FINISHED
2015-03-13 10:11:49,084 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0025 State change from FINISHING to FINISHED
2015-03-13 10:11:49,084 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0025
2015-03-13 10:11:49,084 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0025,name=[716001CDD2B94A3FADE59C5DF8875A2D/9FD5B5C1ECE64C749C8E187DBF5C6990] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0025/jobhistory/job/job_1426266260362_0025,appMasterHost=Edinburgh.local,startTime=1426266686752,finishTime=1426266702257,finalStatus=SUCCEEDED
2015-03-13 10:11:49,085 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0025_000001 is done. finalState=FINISHED
2015-03-13 10:11:49,085 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0025 requests cleared
2015-03-13 10:11:49,085 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0025 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:11:49,085 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0025 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:11:49,085 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0025_000001
2015-03-13 10:11:49,088 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0025_000001 (auth:SIMPLE)
2015-03-13 10:11:49,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0025_01_000001
2015-03-13 10:11:49,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,092 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:49,092 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,092 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,092 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:11:49,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:49,093 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:49,093 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:49,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,093 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,092 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,097 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:49,097 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:49,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,097 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:49,097 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:49,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:49,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0026_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006.tokens
2015-03-13 10:11:49,134 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/nmPrivate/container_1426266260362_0026_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002.tokens
2015-03-13 10:11:49,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:49,135 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:49,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:11:49,216 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63056, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1632195503_13967, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 362000
2015-03-13 10:11:49,216 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63055, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2042911970_13966, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 553000
2015-03-13 10:11:49,238 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,238 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:11:49,266 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63057, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2042911970_13966, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 261000
2015-03-13 10:11:49,266 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63058, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1632195503_13967, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 281000
2015-03-13 10:11:49,280 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,280 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,280 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,280 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:11:49,281 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,281 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,281 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:11:49,341 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,341 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,341 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,341 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,342 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,342 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,342 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,342 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,343 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:11:49,343 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:49,491 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004/default_container_executor.sh]
2015-03-13 10:11:49,496 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003/default_container_executor.sh]
2015-03-13 10:11:49,504 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005/default_container_executor.sh]
2015-03-13 10:11:49,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002/default_container_executor.sh]
2015-03-13 10:11:49,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006/default_container_executor.sh]
2015-03-13 10:11:49,568 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:49,610 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:49,610 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:49,610 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742114_1290 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742114
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742117_1293 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742117
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:49,611 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:49,612 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:49,612 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:49,612 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:49,612 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:49,659 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:49,770 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113 for deletion
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130 for deletion
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116 for deletion
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118 for deletion
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122 for deletion
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742113_1289 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742113
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742130_1306 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742130
2015-03-13 10:11:49,817 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123 for deletion
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124 for deletion
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742118_1294 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742118
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742116_1292 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742116
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125 for deletion
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126 for deletion
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742123_1299 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742123
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742122_1298 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742122
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742125_1301 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742125
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742126_1302 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742126
2015-03-13 10:11:49,818 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742124_1300 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742124
2015-03-13 10:11:49,888 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:11:50,085 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,085 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,085 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:11:50,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,086 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0025
2015-03-13 10:11:50,086 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0025 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:11:50,086 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0025, with delay of 10800 seconds
2015-03-13 10:11:50,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0025
2015-03-13 10:11:50,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,094 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,309 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0026_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003.tokens
2015-03-13 10:11:50,421 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0026_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004.tokens
2015-03-13 10:11:50,422 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,522 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:50,524 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:11:50,663 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:50,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0026_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005.tokens
2015-03-13 10:11:50,668 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:11:50,926 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315
2015-03-13 10:11:51,090 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,091 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,096 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:51,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,093 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,100 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:52,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,099 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:53,670 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,103 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,109 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:54,672 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,106 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,107 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,112 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:55,675 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,111 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,111 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,117 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:56,680 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,116 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,116 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,122 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,123 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,123 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:57,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:57,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:57,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:57,682 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:57,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.split dst=null perm=null
2015-03-13 10:11:57,848 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63071, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000002_0_-806430223_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 167000
2015-03-13 10:11:57,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63072, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000001_0_-1838224352_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 148000
2015-03-13 10:11:57,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63074, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000004_0_154616194_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 147000
2015-03-13 10:11:57,874 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63075, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000003_0_1152914215_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 120000
2015-03-13 10:11:57,955 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63076, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000000_0_928189797_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742136_1312, duration: 147000
2015-03-13 10:11:57,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:57,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:57,991 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63072, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000001_0_-1838224352_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 168000
2015-03-13 10:11:57,994 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63077, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000002_0_-806430223_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 164000
2015-03-13 10:11:57,994 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:57,999 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63078, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000003_0_1152914215_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:11:58,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:58,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63079, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000004_0_154616194_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 145000
2015-03-13 10:11:58,059 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:11:58,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,121 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,126 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,126 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,127 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000002_0 dst=null perm=null
2015-03-13 10:11:58,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000003_0 dst=null perm=null
2015-03-13 10:11:58,497 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000001_0 dst=null perm=null
2015-03-13 10:11:58,512 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000004
2015-03-13 10:11:58,512 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000005
2015-03-13 10:11:58,513 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,512 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,513 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000004
2015-03-13 10:11:58,513 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,513 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,513 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,513 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,526 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000004 is : 143
2015-03-13 10:11:58,529 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:11:58,531 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63080 dest: /127.0.0.1:60693
2015-03-13 10:11:58,533 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63081 dest: /127.0.0.1:60686
2015-03-13 10:11:58,534 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316 src: /127.0.0.1:63082 dest: /127.0.0.1:60696
2015-03-13 10:11:58,539 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist for DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:11:58,540 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,541 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,541 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000005
2015-03-13 10:11:58,554 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000005 is : 143
2015-03-13 10:11:58,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000004_0 dst=null perm=null
2015-03-13 10:11:58,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,566 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,567 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,567 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,567 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000005
2015-03-13 10:11:58,567 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000004 from application application_1426266260362_0026
2015-03-13 10:11:58,568 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,568 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,568 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,568 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,568 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000005 from application application_1426266260362_0026
2015-03-13 10:11:58,569 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,569 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,575 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000003
2015-03-13 10:11:58,575 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,575 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,575 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000003
2015-03-13 10:11:58,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,576 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,579 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,580 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000006
2015-03-13 10:11:58,580 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,580 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000004
2015-03-13 10:11:58,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000005
2015-03-13 10:11:58,581 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,581 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,582 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,582 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000004
2015-03-13 10:11:58,582 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:11:58,582 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:11:58,582 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,582 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,582 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:11:58,582 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000004 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:11:58,582 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,582 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,582 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000005
2015-03-13 10:11:58,583 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:58,583 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:11:58,583 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,583 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,583 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:11:58,583 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000005 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:58,591 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000003 is : 143
2015-03-13 10:11:58,595 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000006 is : 143
2015-03-13 10:11:58,603 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,603 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,604 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,604 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,605 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000003 from application application_1426266260362_0026
2015-03-13 10:11:58,605 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,605 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,604 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000006 from application application_1426266260362_0026
2015-03-13 10:11:58,605 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,605 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:58,604 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000006
2015-03-13 10:11:58,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,606 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,605 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000003
2015-03-13 10:11:58,622 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63083, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0026_m_000000_0_928189797_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 160000
2015-03-13 10:11:58,646 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_m_000000_0 dst=null perm=null
2015-03-13 10:11:58,667 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:11:58,667 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000002
2015-03-13 10:11:58,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:11:58,667 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:58,668 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000003
2015-03-13 10:11:58,668 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:58,668 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:11:58,668 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000003
2015-03-13 10:11:58,668 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:11:58,668 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:11:58,669 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000003, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,669 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:58,669 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:11:58,669 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000003 on node: host: 10.1.1.144:60723 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:11:58,679 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000002 is : 143
2015-03-13 10:11:58,691 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:11:58,695 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:11:58,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000002
2015-03-13 10:11:58,695 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:11:58,696 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000002 from application application_1426266260362_0026
2015-03-13 10:11:58,696 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:11:58,696 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:11:59,583 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:59,583 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000006
2015-03-13 10:11:59,583 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:59,584 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:11:59,584 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000006
2015-03-13 10:11:59,584 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:59,584 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:11:59,584 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,584 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,584 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:11:59,585 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000006 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:59,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:11:59,671 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000002
2015-03-13 10:11:59,672 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:11:59,672 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:11:59,672 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000002
2015-03-13 10:11:59,672 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:11:59,672 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:11:59,673 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000002, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,673 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:11:59,673 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:11:59,673 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000002 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:11:59,693 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:00,133 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:00,133 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:00,133 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:00,133 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0026 container=Container: [ContainerId: container_1426266260362_0026_01_000007, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0026_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:00,133 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:00,133 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:00,695 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:00,939 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:00,950 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:12:00,951 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0026_01_000007 by user soberoi
2015-03-13 10:12:00,952 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0026
2015-03-13 10:12:00,952 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:00,952 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from NEW to INITING
2015-03-13 10:12:00,952 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0026_01_000007 to application application_1426266260362_0026
2015-03-13 10:12:00,952 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from INITING to RUNNING
2015-03-13 10:12:00,952 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:12:00,952 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0026
2015-03-13 10:12:00,952 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0026
2015-03-13 10:12:00,952 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:00,953 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0026
2015-03-13 10:12:00,953 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:00,953 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:00,953 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0026_01_000007
2015-03-13 10:12:00,962 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0026_01_000007.tokens. Credentials list:
2015-03-13 10:12:00,977 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:01,041 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0026_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007.tokens
2015-03-13 10:12:01,041 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:01,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:12:01,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:12:01,097 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar dst=null perm=null
2015-03-13 10:12:01,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63087, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1926691887_14282, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742135_1311, duration: 445000
2015-03-13 10:12:01,122 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:01,133 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:01,134 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:01,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:12:01,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:12:01,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml dst=null perm=null
2015-03-13 10:12:01,146 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63088, bytes: 98662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1926691887_14282, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742138_1314, duration: 310000
2015-03-13 10:12:01,158 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:01,159 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:01,185 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:01,185 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:01,250 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007/default_container_executor.sh]
2015-03-13 10:12:01,695 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:01,946 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:12:02,138 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:02,700 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,142 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,699 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:03,705 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:03,757 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63093 dest: /127.0.0.1:60696
2015-03-13 10:12:03,758 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63094 dest: /127.0.0.1:60693
2015-03-13 10:12:03,759 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317 src: /127.0.0.1:63095 dest: /127.0.0.1:60686
2015-03-13 10:12:03,772 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63095, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 10769000
2015-03-13 10:12:03,772 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,772 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63094, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 11104000
2015-03-13 10:12:03,772 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,773 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,773 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,773 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63093, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 11770000
2015-03-13 10:12:03,773 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,774 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742141_1317{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:03,776 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0026_r_000000_0_929310349_1
2015-03-13 10:12:03,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0 dst=null perm=null
2015-03-13 10:12:03,789 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0 dst=null perm=null
2015-03-13 10:12:03,790 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000 dst=null perm=null
2015-03-13 10:12:03,793 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/_temporary/attempt_1426266260362_0026_r_000000_0 dst=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:03,800 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:12:03,801 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000007
2015-03-13 10:12:03,801 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:03,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,809 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,813 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0026_01_000007 is : 143
2015-03-13 10:12:03,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1 dst=null perm=null
2015-03-13 10:12:03,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:03,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:03,822 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:03,823 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:03,823 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:03,823 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000007 from application application_1426266260362_0026
2015-03-13 10:12:03,823 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:03,823 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:12:03,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000007
2015-03-13 10:12:03,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000 dst=null perm=null
2015-03-13 10:12:03,827 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:03,829 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary/1/task_1426266260362_0026_r_000000/part-00000 dst=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_temporary dst=null perm=null
2015-03-13 10:12:03,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,839 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,842 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,855 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63082, dest: /127.0.0.1:60696, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5319467000
2015-03-13 10:12:03,855 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,856 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,857 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63081, dest: /127.0.0.1:60686, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5320199000
2015-03-13 10:12:03,857 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,858 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,858 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63080, dest: /127.0.0.1:60693, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 5321683000
2015-03-13 10:12:03,858 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742140_1316{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,860 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,864 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:03,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63096 dest: /127.0.0.1:60686
2015-03-13 10:12:03,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63097 dest: /127.0.0.1:60696
2015-03-13 10:12:03,868 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318 src: /127.0.0.1:63098 dest: /127.0.0.1:60693
2015-03-13 10:12:03,871 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63098, dest: /127.0.0.1:60693, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 1233000
2015-03-13 10:12:03,871 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,872 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,872 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63097, dest: /127.0.0.1:60696, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 1696000
2015-03-13 10:12:03,872 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,872 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,873 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63096, dest: /127.0.0.1:60686, bytes: 426, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 2533000
2015-03-13 10:12:03,873 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,873 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742142_1318{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:03,875 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,878 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist dst=null perm=null
2015-03-13 10:12:03,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:03,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist dst=null perm=null
2015-03-13 10:12:03,888 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:03,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1.jhist dst=null perm=null
2015-03-13 10:12:03,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,897 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63099, bytes: 63883, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316, duration: 212000
2015-03-13 10:12:03,899 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:03,900 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63100 dest: /127.0.0.1:60689
2015-03-13 10:12:03,902 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63101 dest: /127.0.0.1:60693
2015-03-13 10:12:03,903 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319 src: /127.0.0.1:63102 dest: /127.0.0.1:60696
2015-03-13 10:12:03,906 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63102, dest: /127.0.0.1:60696, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 2198000
2015-03-13 10:12:03,907 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,907 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,907 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63101, dest: /127.0.0.1:60693, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 2532000
2015-03-13 10:12:03,907 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,908 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,908 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63100, dest: /127.0.0.1:60689, bytes: 63387, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, duration: 3303000
2015-03-13 10:12:03,908 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,908 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742143_1319{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:03,910 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml dst=null perm=null
2015-03-13 10:12:03,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:03,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml dst=null perm=null
2015-03-13 10:12:03,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:03,917 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026/job_1426266260362_0026_1_conf.xml dst=null perm=null
2015-03-13 10:12:03,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:03,922 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63099, bytes: 91314, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742139_1315, duration: 310000
2015-03-13 10:12:03,924 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:03,926 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63103 dest: /127.0.0.1:60696
2015-03-13 10:12:03,927 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63104 dest: /127.0.0.1:60686
2015-03-13 10:12:03,928 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320 src: /127.0.0.1:63105 dest: /127.0.0.1:60689
2015-03-13 10:12:03,932 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63105, dest: /127.0.0.1:60689, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 1784000
2015-03-13 10:12:03,932 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:03,932 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,932 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63104, dest: /127.0.0.1:60686, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 2482000
2015-03-13 10:12:03,933 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,933 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,933 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63103, dest: /127.0.0.1:60696, bytes: 90606, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2132822748_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, duration: 3226000
2015-03-13 10:12:03,933 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:03,934 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742144_1320{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:03,935 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2132822748_1
2015-03-13 10:12:03,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:03,946 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:03,946 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0026
2015-03-13 10:12:03,946 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from RUNNING to REMOVING
2015-03-13 10:12:03,946 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0026
2015-03-13 10:12:03,946 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from REMOVING to FINISHING
2015-03-13 10:12:04,710 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:04,779 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:04,780 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:04,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:04,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000007
2015-03-13 10:12:04,802 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:04,802 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:12:04,803 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000007
2015-03-13 10:12:04,803 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:04,803 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:04,803 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000007, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:04,803 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:04,803 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:04,804 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000007 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:04,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742135_1311 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:12:04,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742136_1312 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:12:04,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742137_1313 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:12:04,958 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742138_1314 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:12:04,959 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742140_1316 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:12:04,959 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742139_1315 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:12:04,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0026 dst=null perm=null
2015-03-13 10:12:04,987 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/2) ...atform/joinfilteredbranch
2015-03-13 10:12:04,994 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,002 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:05,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:05,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:05,008 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 27
2015-03-13 10:12:05,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=null
2015-03-13 10:12:05,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:05,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:12:05,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,015 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:05,017 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63108 dest: /127.0.0.1:60686
2015-03-13 10:12:05,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63109 dest: /127.0.0.1:60689
2015-03-13 10:12:05,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63110 dest: /127.0.0.1:60696
2015-03-13 10:12:05,023 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63110, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 2607000
2015-03-13 10:12:05,023 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,023 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,023 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63109, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 2755000
2015-03-13 10:12:05,023 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,024 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,024 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63108, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 3542000
2015-03-13 10:12:05,024 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,025 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742145_1321{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,025 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,026 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar
2015-03-13 10:12:05,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:05,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:05,030 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:05,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:12:05,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:12:05,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:12:05,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:12:05,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:12:05,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:05,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:05,035 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:05,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:05,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,039 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split
2015-03-13 10:12:05,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,040 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:05,041 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63111 dest: /127.0.0.1:60686
2015-03-13 10:12:05,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63112 dest: /127.0.0.1:60696
2015-03-13 10:12:05,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63113 dest: /127.0.0.1:60693
2015-03-13 10:12:05,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322 src: /127.0.0.1:63114 dest: /127.0.0.1:60689
2015-03-13 10:12:05,047 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63114, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 1582000
2015-03-13 10:12:05,047 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,047 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,047 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63113, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 1797000
2015-03-13 10:12:05,048 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,048 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,048 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63112, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 2746000
2015-03-13 10:12:05,048 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,049 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63111, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 3109000
2015-03-13 10:12:05,049 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742146_1322{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:05,051 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,053 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,054 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:05,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63115 dest: /127.0.0.1:60689
2015-03-13 10:12:05,056 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63116 dest: /127.0.0.1:60686
2015-03-13 10:12:05,057 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323 src: /127.0.0.1:63117 dest: /127.0.0.1:60693
2015-03-13 10:12:05,060 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63117, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 1173000
2015-03-13 10:12:05,060 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,060 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,060 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63116, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 1570000
2015-03-13 10:12:05,061 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,061 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,061 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63115, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 2564000
2015-03-13 10:12:05,061 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,062 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742147_1323{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:05,063 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,063 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:05,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:05,068 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:05,069 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:05,069 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:05,074 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:05,075 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63118 dest: /127.0.0.1:60686
2015-03-13 10:12:05,076 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63119 dest: /127.0.0.1:60693
2015-03-13 10:12:05,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324 src: /127.0.0.1:63120 dest: /127.0.0.1:60696
2015-03-13 10:12:05,080 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63120, dest: /127.0.0.1:60696, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 1353000
2015-03-13 10:12:05,080 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:05,080 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,081 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63119, dest: /127.0.0.1:60693, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 1762000
2015-03-13 10:12:05,081 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,081 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,081 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63118, dest: /127.0.0.1:60686, bytes: 98188, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 2439000
2015-03-13 10:12:05,081 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:05,082 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742148_1324{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:05,083 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:05,083 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0027
2015-03-13 10:12:05,083 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=null
2015-03-13 10:12:05,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:05,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:05,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,085 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:05,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:05,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:05,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:05,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:05,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:05,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:05,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:05,092 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 27 submitted by user soberoi
2015-03-13 10:12:05,092 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0027
2015-03-13 10:12:05,092 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0027
2015-03-13 10:12:05,092 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0027
2015-03-13 10:12:05,092 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from NEW to NEW_SAVING
2015-03-13 10:12:05,093 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:05,093 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,093 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:05,093 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0027 from user: soberoi activated in queue: default
2015-03-13 10:12:05,093 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0027 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:05,093 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0027 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:05,093 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0027 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:05,093 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0027_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:05,094 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:05,095 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:05,095 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0027/
2015-03-13 10:12:05,096 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0027
2015-03-13 10:12:05,096 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0027/
2015-03-13 10:12:05,389 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:05,390 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:05,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:05,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:05,391 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,392 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:05,392 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:05,534 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,535 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:05,536 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:05,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:05,537 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:05,602 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:05,602 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:05,602 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:05,602 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0027_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:05,602 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:05,603 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:05,603 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:05,604 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0027 AttemptId: appattempt_1426266260362_0027_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:05,604 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:05,604 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,604 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:05,604 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0027_000001
2015-03-13 10:12:05,605 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,605 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0027_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:12:05,607 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:05,608 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000001 by user soberoi
2015-03-13 10:12:05,608 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0027
2015-03-13 10:12:05,608 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:05,609 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from NEW to INITING
2015-03-13 10:12:05,609 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000001 to application application_1426266260362_0027
2015-03-13 10:12:05,609 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from INITING to RUNNING
2015-03-13 10:12:05,609 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0027_000001
2015-03-13 10:12:05,609 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:05,609 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:05,609 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:05,609 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:05,610 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000001
2015-03-13 10:12:05,619 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0027_01_000001.tokens. Credentials list:
2015-03-13 10:12:05,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:05,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0027_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001.tokens
2015-03-13 10:12:05,701 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:05,719 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:05,738 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:05,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:05,739 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:05,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:05,774 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63124, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 502000
2015-03-13 10:12:05,792 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:05,809 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:05,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:05,816 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63125, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 128000
2015-03-13 10:12:05,829 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:05,852 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63126, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 189000
2015-03-13 10:12:05,865 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,881 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:05,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:05,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:05,888 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63126, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-387356058_14425, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 306000
2015-03-13 10:12:05,900 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:05,900 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:05,926 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:05,926 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:05,938 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:05,939 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742144_1320
2015-03-13 10:12:05,995 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001/default_container_executor.sh]
2015-03-13 10:12:06,140 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:06,140 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742140_1316
2015-03-13 10:12:06,141 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742143_1319
2015-03-13 10:12:06,141 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317
2015-03-13 10:12:06,142 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318
2015-03-13 10:12:06,340 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324
2015-03-13 10:12:06,603 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:06,603 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:06,720 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,043 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60689 to replicate blk_1073742145_1321 to datanode(s) 127.0.0.1:60693
2015-03-13 10:12:07,043 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315, blk_1073742140_1316]
2015-03-13 10:12:07,044 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742139_1315, blk_1073742140_1316]
2015-03-13 10:12:07,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:07,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED dst=null perm=null
2015-03-13 10:12:07,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:12:07,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_FAIL dst=null perm=null
2015-03-13 10:12:07,607 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:07,621 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1172757413-10.1.1.144-60689-1426266259165, infoPort=60690, ipcPort=60692, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 to 127.0.0.1:60693
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:07,621 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:07,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:07,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:07,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:07,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:07,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:07,623 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63128 dest: /127.0.0.1:60693
2015-03-13 10:12:07,623 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:12:07,624 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321 src: /127.0.0.1:63128 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:12:07,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742145_1321 size 254067
2015-03-13 10:12:07,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=null
2015-03-13 10:12:07,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:12:07,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:12:07,725 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:07,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:07,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:07,993 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63129, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323, duration: 131000
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:08,011 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:08,012 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:08,612 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:08,726 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:08,768 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:08,769 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0027_000001
2015-03-13 10:12:08,769 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0027 APPATTEMPTID=appattempt_1426266260362_0027_000001
2015-03-13 10:12:08,770 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:08,770 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from ACCEPTED to RUNNING
2015-03-13 10:12:08,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:08,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:08,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:08,977 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:09,018 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63135 dest: /127.0.0.1:60686
2015-03-13 10:12:09,019 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63136 dest: /127.0.0.1:60696
2015-03-13 10:12:09,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325 src: /127.0.0.1:63137 dest: /127.0.0.1:60693
2015-03-13 10:12:09,030 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63137, dest: /127.0.0.1:60693, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 6637000
2015-03-13 10:12:09,031 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:09,031 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,031 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63136, dest: /127.0.0.1:60696, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 7479000
2015-03-13 10:12:09,032 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:09,033 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,033 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63135, dest: /127.0.0.1:60686, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 9059000
2015-03-13 10:12:09,033 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:09,034 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742149_1325{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:09,037 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:09,617 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:09,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:09,785 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322
2015-03-13 10:12:09,786 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:09,786 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742147_1323
2015-03-13 10:12:09,820 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,820 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:09,820 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:09,820 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,820 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:09,821 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,821 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,821 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:09,821 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:09,822 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,822 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:09,822 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,823 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:09,823 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:09,823 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:09,823 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,823 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:09,823 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:09,823 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:09,824 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0027_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:09,824 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:09,824 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,049 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742137_1313, blk_1073742138_1314, blk_1073742140_1316]
2015-03-13 10:12:10,050 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742135_1311, blk_1073742136_1312, blk_1073742139_1315]
2015-03-13 10:12:10,090 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0026_01_000001 succeeded
2015-03-13 10:12:10,090 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:10,090 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0026_01_000001
2015-03-13 10:12:10,097 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0026/container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:12:10,098 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0026_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:10,098 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0026_01_000001 from application application_1426266260362_0026
2015-03-13 10:12:10,098 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:10,098 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0026
2015-03-13 10:12:10,395 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:10,600 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321
2015-03-13 10:12:10,620 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:10,621 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:10,621 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:10,622 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:10,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:10,622 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0027 container=Container: [ContainerId: container_1426266260362_0027_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0027_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:10,622 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:10,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139 for deletion
2015-03-13 10:12:10,622 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:10,622 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,623 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:10,623 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742139_1315 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742139
2015-03-13 10:12:10,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 26 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:10,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0026_01_000001
2015-03-13 10:12:10,734 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0026_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:10,734 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0026_000001
2015-03-13 10:12:10,734 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0026_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:10,734 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0026 CONTAINERID=container_1426266260362_0026_01_000001
2015-03-13 10:12:10,734 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0026_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:10,734 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0026_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:10,735 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0026 State change from FINISHING to FINISHED
2015-03-13 10:12:10,735 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:10,735 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0026_000001
2015-03-13 10:12:10,735 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0026_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,735 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0026
2015-03-13 10:12:10,735 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:10,735 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0026,name=[D22FDB06DDD24032BF29C6EAE9E54D4B/116CA5A33C1047FAA2216FF3C2C5902D] lower*upper/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0026/jobhistory/job/job_1426266260362_0026,appMasterHost=Edinburgh.local,startTime=1426266703493,finishTime=1426266723946,finalStatus=SUCCEEDED
2015-03-13 10:12:10,735 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:10,736 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0026_000001 released container container_1426266260362_0026_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:10,736 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0026_000001 is done. finalState=FINISHED
2015-03-13 10:12:10,736 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0026 requests cleared
2015-03-13 10:12:10,736 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0026 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:10,736 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0026 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:10,738 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0026_000001 (auth:SIMPLE)
2015-03-13 10:12:10,739 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0026_01_000001
2015-03-13 10:12:10,747 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:10,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:10,823 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:10,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,823 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,824 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:10,824 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:10,824 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:10,824 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:10,830 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:10,831 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:10,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135 for deletion
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136 for deletion
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137 for deletion
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138 for deletion
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140 for deletion
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742135_1311 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742135
2015-03-13 10:12:10,840 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742136_1312 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742136
2015-03-13 10:12:10,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:10,841 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742137_1313 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742137
2015-03-13 10:12:10,841 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742138_1314 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742138
2015-03-13 10:12:10,841 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742140_1316 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742140
2015-03-13 10:12:10,843 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:10,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:10,848 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:10,850 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:10,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:10,853 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:10,929 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:10,929 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:10,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000002 by user soberoi
2015-03-13 10:12:10,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0027
2015-03-13 10:12:10,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000004 by user soberoi
2015-03-13 10:12:10,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:10,933 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000003 by user soberoi
2015-03-13 10:12:10,933 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000005 by user soberoi
2015-03-13 10:12:10,933 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:10,933 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:10,932 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from NEW to INITING
2015-03-13 10:12:10,934 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000002 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000004 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000003 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000005 to application application_1426266260362_0027
2015-03-13 10:12:10,934 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from INITING to RUNNING
2015-03-13 10:12:10,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:10,934 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,933 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0027_01_000006 by user soberoi
2015-03-13 10:12:10,935 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:10,934 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,935 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,935 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,935 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,935 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:10,936 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:10,935 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0027_01_000006 to application application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,936 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,936 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,936 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:10,936 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,937 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,937 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,937 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0027
2015-03-13 10:12:10,937 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:10,937 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0027
2015-03-13 10:12:10,937 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000005
2015-03-13 10:12:10,938 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000003
2015-03-13 10:12:10,941 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000004
2015-03-13 10:12:10,943 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0027_01_000002
2015-03-13 10:12:10,959 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000002.tokens. Credentials list:
2015-03-13 10:12:10,961 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0027_01_000005.tokens. Credentials list:
2015-03-13 10:12:10,962 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000003.tokens. Credentials list:
2015-03-13 10:12:10,964 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0027_01_000004.tokens. Credentials list:
2015-03-13 10:12:10,977 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:10,977 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:10,980 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:11,045 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006/default_container_executor.sh]
2015-03-13 10:12:11,053 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002.tokens
2015-03-13 10:12:11,054 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:11,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:11,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:11,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar dst=null perm=null
2015-03-13 10:12:11,122 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63143, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2011957545_14561, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742145_1321, duration: 367000
2015-03-13 10:12:11,143 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:11,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:11,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:11,162 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml dst=null perm=null
2015-03-13 10:12:11,170 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63144, bytes: 98956, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2011957545_14561, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742148_1324, duration: 309000
2015-03-13 10:12:11,186 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:11,186 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,186 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:11,269 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,269 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,269 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,269 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,270 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:11,270 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:11,346 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325
2015-03-13 10:12:11,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005/default_container_executor.sh]
2015-03-13 10:12:11,416 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002/default_container_executor.sh]
2015-03-13 10:12:11,417 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004/default_container_executor.sh]
2015-03-13 10:12:11,418 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003/default_container_executor.sh]
2015-03-13 10:12:11,622 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,622 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,622 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,623 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,623 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,624 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,713 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,713 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,713 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,713 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,713 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,714 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,715 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,738 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:11,738 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,738 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0026
2015-03-13 10:12:11,739 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0026 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:11,739 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0026, with delay of 10800 seconds
2015-03-13 10:12:11,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,740 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0026
2015-03-13 10:12:11,818 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:12:11,825 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,825 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:11,826 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:11,826 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:12,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0027_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004.tokens
2015-03-13 10:12:12,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0027_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003.tokens
2015-03-13 10:12:12,586 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,625 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,625 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,685 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:12,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0027_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005.tokens
2015-03-13 10:12:12,805 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:12,828 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:12,828 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,631 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,833 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,834 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:13,834 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,633 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,837 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:14,838 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,634 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,635 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,843 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,844 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:15,844 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,844 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,844 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,845 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:16,845 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,639 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,850 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:17,851 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,643 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:18,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,854 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:18,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63154, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 145000
2015-03-13 10:12:18,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:19,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:19,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:19,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job.split dst=null perm=null
2015-03-13 10:12:19,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:19,158 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63160, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 142000
2015-03-13 10:12:19,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,204 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63159, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 152000
2015-03-13 10:12:19,219 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63161, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 145000
2015-03-13 10:12:19,246 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63162, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 155000
2015-03-13 10:12:19,306 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63163, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 512, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742146_1322, duration: 179000
2015-03-13 10:12:19,347 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:19,351 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63164, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 147000
2015-03-13 10:12:19,367 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:19,371 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63165, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 138000
2015-03-13 10:12:19,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:19,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,407 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,423 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:19,427 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63163, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 156000
2015-03-13 10:12:19,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:19,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,617 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,676 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63166, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 184000
2015-03-13 10:12:19,698 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0027_m_000004_0_1216806613_1
2015-03-13 10:12:19,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0 dst=null perm=null
2015-03-13 10:12:19,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0 dst=null perm=null
2015-03-13 10:12:19,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004 dst=null perm=null
2015-03-13 10:12:19,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:19,748 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:19,748 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000006
2015-03-13 10:12:19,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:19,761 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000006 is : 143
2015-03-13 10:12:19,762 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:19,764 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63167 dest: /127.0.0.1:60686
2015-03-13 10:12:19,765 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63168 dest: /127.0.0.1:60689
2015-03-13 10:12:19,767 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326 src: /127.0.0.1:63169 dest: /127.0.0.1:60696
2015-03-13 10:12:19,771 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist for DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:19,772 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:19,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000006
2015-03-13 10:12:19,773 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:19,774 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:19,774 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000006 from application application_1426266260362_0027
2015-03-13 10:12:19,774 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:19,774 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:19,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,810 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,812 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,838 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63170, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 146000
2015-03-13 10:12:19,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,852 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,854 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,857 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63161, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 159000
2015-03-13 10:12:19,858 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,859 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:19,880 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:19,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,885 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,889 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63172, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 150000
2015-03-13 10:12:19,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:19,912 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:19,913 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63173, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:12:19,921 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63171 dest: /127.0.0.1:60689
2015-03-13 10:12:19,923 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63175 dest: /127.0.0.1:60686
2015-03-13 10:12:19,924 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327 src: /127.0.0.1:63176 dest: /127.0.0.1:60693
2015-03-13 10:12:19,933 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63176, dest: /127.0.0.1:60693, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 7453000
2015-03-13 10:12:19,933 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:19,934 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,934 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63175, dest: /127.0.0.1:60686, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 8247000
2015-03-13 10:12:19,934 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:19,934 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,935 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63171, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 8959000
2015-03-13 10:12:19,935 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:19,935 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742151_1327{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:19,941 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0027_m_000001_0_-383774985_1
2015-03-13 10:12:19,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,949 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:19,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0/part-00000 dst=null perm=null
2015-03-13 10:12:19,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0 dst=null perm=null
2015-03-13 10:12:19,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63178, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742141_1317, duration: 152000
2015-03-13 10:12:19,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0 dst=null perm=null
2015-03-13 10:12:19,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001 dst=null perm=null
2015-03-13 10:12:19,968 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63174 dest: /127.0.0.1:60689
2015-03-13 10:12:19,969 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63179 dest: /127.0.0.1:60696
2015-03-13 10:12:19,970 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328 src: /127.0.0.1:63180 dest: /127.0.0.1:60686
2015-03-13 10:12:19,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:19,989 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63180, dest: /127.0.0.1:60686, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 17108000
2015-03-13 10:12:19,989 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000003
2015-03-13 10:12:19,989 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:19,990 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:19,989 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:19,990 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:19,990 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000003
2015-03-13 10:12:20,003 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63177 dest: /127.0.0.1:60686
2015-03-13 10:12:20,003 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63179, dest: /127.0.0.1:60696, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 17832000
2015-03-13 10:12:20,004 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,004 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:20,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,004 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63174, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 32396000
2015-03-13 10:12:20,005 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63181 dest: /127.0.0.1:60689
2015-03-13 10:12:20,006 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742152_1328{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:20,007 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329 src: /127.0.0.1:63182 dest: /127.0.0.1:60693
2015-03-13 10:12:20,013 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0027_m_000003_0_-857504959_1
2015-03-13 10:12:20,015 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63182, dest: /127.0.0.1:60693, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 6824000
2015-03-13 10:12:20,016 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,016 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63181, dest: /127.0.0.1:60689, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 7753000
2015-03-13 10:12:20,017 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,017 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000003 is : 143
2015-03-13 10:12:20,018 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63177, dest: /127.0.0.1:60686, bytes: 28, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 9169000
2015-03-13 10:12:20,018 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,018 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,018 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,019 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742153_1329{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,026 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0027_m_000000_0_-85006992_1
2015-03-13 10:12:20,029 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0 dst=null perm=null
2015-03-13 10:12:20,032 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,032 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000003
2015-03-13 10:12:20,033 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:20,033 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,033 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000003 from application application_1426266260362_0027
2015-03-13 10:12:20,033 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,033 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,036 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0 dst=null perm=null
2015-03-13 10:12:20,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003 dst=null perm=null
2015-03-13 10:12:20,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0 dst=null perm=null
2015-03-13 10:12:20,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0 dst=null perm=null
2015-03-13 10:12:20,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000 dst=null perm=null
2015-03-13 10:12:20,050 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:20,052 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,052 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,052 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000005
2015-03-13 10:12:20,052 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000003
2015-03-13 10:12:20,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,053 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,053 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,054 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000003
2015-03-13 10:12:20,054 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:20,054 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:20,054 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,054 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,054 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:20,054 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000003 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:20,064 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000005 is : 143
2015-03-13 10:12:20,067 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000002
2015-03-13 10:12:20,067 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,068 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:12:20,077 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,077 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,077 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000005
2015-03-13 10:12:20,078 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000002
2015-03-13 10:12:20,089 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000002 is : 143
2015-03-13 10:12:20,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63183 dest: /127.0.0.1:60696
2015-03-13 10:12:20,096 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,097 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63184 dest: /127.0.0.1:60689
2015-03-13 10:12:20,097 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,097 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000005 from application application_1426266260362_0027
2015-03-13 10:12:20,097 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,097 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330 src: /127.0.0.1:63185 dest: /127.0.0.1:60693
2015-03-13 10:12:20,098 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,099 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,100 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,100 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000002 from application application_1426266260362_0027
2015-03-13 10:12:20,100 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,100 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,105 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63185, dest: /127.0.0.1:60693, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 5775000
2015-03-13 10:12:20,105 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,106 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,106 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63184, dest: /127.0.0.1:60689, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 6175000
2015-03-13 10:12:20,106 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,106 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,106 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63183, dest: /127.0.0.1:60696, bytes: 14, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 7106000
2015-03-13 10:12:20,107 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,107 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742154_1330{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:20,111 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0027_m_000002_0_412761673_1
2015-03-13 10:12:20,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0 dst=null perm=null
2015-03-13 10:12:20,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0 dst=null perm=null
2015-03-13 10:12:20,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002 dst=null perm=null
2015-03-13 10:12:20,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/_temporary/attempt_1426266260362_0027_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:20,139 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000004
2015-03-13 10:12:20,139 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:20,139 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:20,139 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000004
2015-03-13 10:12:20,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000002
2015-03-13 10:12:20,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:20,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000005
2015-03-13 10:12:20,140 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,141 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,141 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000002
2015-03-13 10:12:20,141 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:20,141 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:20,141 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,141 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,141 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:20,141 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000002 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:20,141 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,141 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,141 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000005
2015-03-13 10:12:20,141 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:20,142 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:20,142 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:20,142 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000005 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:20,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,145 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1 dst=null perm=null
2015-03-13 10:12:20,149 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0027_01_000004 is : 143
2015-03-13 10:12:20,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000 dst=null perm=null
2015-03-13 10:12:20,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2015-03-13 10:12:20,158 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:20,158 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:20,159 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000004 from application application_1426266260362_0027
2015-03-13 10:12:20,159 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:20,159 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:20,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000004
2015-03-13 10:12:20,161 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,164 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001 dst=null perm=null
2015-03-13 10:12:20,167 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2015-03-13 10:12:20,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002 dst=null perm=null
2015-03-13 10:12:20,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2015-03-13 10:12:20,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,176 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,178 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003 dst=null perm=null
2015-03-13 10:12:20,180 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2015-03-13 10:12:20,181 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:20,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004 dst=null perm=null
2015-03-13 10:12:20,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2015-03-13 10:12:20,187 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary/1/task_1426266260362_0027_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary dst=null perm=null
2015-03-13 10:12:20,193 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,195 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,196 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,198 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,208 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63169, dest: /127.0.0.1:60696, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 440089000
2015-03-13 10:12:20,208 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,209 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,209 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63168, dest: /127.0.0.1:60689, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 441231000
2015-03-13 10:12:20,210 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,210 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,211 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63167, dest: /127.0.0.1:60686, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 442534000
2015-03-13 10:12:20,211 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,211 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742150_1326{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,212 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,217 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:20,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63186 dest: /127.0.0.1:60686
2015-03-13 10:12:20,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63187 dest: /127.0.0.1:60693
2015-03-13 10:12:20,222 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331 src: /127.0.0.1:63188 dest: /127.0.0.1:60689
2015-03-13 10:12:20,224 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63188, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 1233000
2015-03-13 10:12:20,225 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,225 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,225 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63187, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 1821000
2015-03-13 10:12:20,225 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63186, dest: /127.0.0.1:60686, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 2683000
2015-03-13 10:12:20,226 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742155_1331{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:20,228 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist dst=null perm=null
2015-03-13 10:12:20,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:20,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist dst=null perm=null
2015-03-13 10:12:20,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:20,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1.jhist dst=null perm=null
2015-03-13 10:12:20,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,245 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63189, bytes: 53749, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326, duration: 151000
2015-03-13 10:12:20,247 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:20,249 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63190 dest: /127.0.0.1:60689
2015-03-13 10:12:20,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63191 dest: /127.0.0.1:60693
2015-03-13 10:12:20,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332 src: /127.0.0.1:63192 dest: /127.0.0.1:60696
2015-03-13 10:12:20,254 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63192, dest: /127.0.0.1:60696, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 1608000
2015-03-13 10:12:20,254 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,254 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,254 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63191, dest: /127.0.0.1:60693, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 2109000
2015-03-13 10:12:20,254 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63190, dest: /127.0.0.1:60689, bytes: 53329, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, duration: 2829000
2015-03-13 10:12:20,255 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,255 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742156_1332{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,257 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml dst=null perm=null
2015-03-13 10:12:20,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:20,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml dst=null perm=null
2015-03-13 10:12:20,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:20,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027/job_1426266260362_0027_1_conf.xml dst=null perm=null
2015-03-13 10:12:20,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:20,269 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63193, bytes: 91702, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742149_1325, duration: 274000
2015-03-13 10:12:20,272 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:20,274 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63194 dest: /127.0.0.1:60689
2015-03-13 10:12:20,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63195 dest: /127.0.0.1:60693
2015-03-13 10:12:20,278 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333 src: /127.0.0.1:63196 dest: /127.0.0.1:60696
2015-03-13 10:12:20,282 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63196, dest: /127.0.0.1:60696, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 2131000
2015-03-13 10:12:20,282 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:20,283 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,283 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63195, dest: /127.0.0.1:60693, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 2769000
2015-03-13 10:12:20,283 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,284 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,284 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63194, dest: /127.0.0.1:60689, bytes: 90990, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-147161382_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, duration: 3848000
2015-03-13 10:12:20,284 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:20,285 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742157_1333{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:20,286 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-147161382_1
2015-03-13 10:12:20,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,292 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:20,298 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:20,298 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0027
2015-03-13 10:12:20,298 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from RUNNING to REMOVING
2015-03-13 10:12:20,298 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0027
2015-03-13 10:12:20,298 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from REMOVING to FINISHING
2015-03-13 10:12:20,609 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:20,610 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:20,610 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:20,611 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:20,611 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:20,612 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:20,754 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000006
2015-03-13 10:12:20,755 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:20,755 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:20,755 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000006
2015-03-13 10:12:20,755 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:20,755 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:20,756 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,756 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:20,756 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:20,756 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:20,756 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:20,757 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326
2015-03-13 10:12:20,757 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:20,757 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:20,758 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:21,141 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:21,141 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000004
2015-03-13 10:12:21,142 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:21,142 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:21,142 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000004
2015-03-13 10:12:21,142 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:21,143 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:21,143 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,143 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,143 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:21,143 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000004 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:21,309 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742145_1321 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:12:21,310 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742146_1322 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:12:21,310 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742147_1323 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:12:21,310 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742148_1324 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:12:21,310 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742150_1326 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:12:21,310 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742149_1325 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:12:21,311 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0027 dst=null perm=null
2015-03-13 10:12:21,341 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742141_1317 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:12:21,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/9862538673_upper_BA34469FE45D4282B137ED3EF2672AB0 dst=null perm=null
2015-03-13 10:12:21,342 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,342 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary
2015-03-13 10:12:21,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/_temporary dst=null perm=null
2015-03-13 10:12:21,349 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,350 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,350 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,351 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:21,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,352 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:21,352 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,352 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:21,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742150_1326
2015-03-13 10:12:21,353 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:21,354 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:21,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2015-03-13 10:12:21,356 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 151000
2015-03-13 10:12:21,357 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2015-03-13 10:12:21,358 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 154000
2015-03-13 10:12:21,359 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2015-03-13 10:12:21,361 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 156000
2015-03-13 10:12:21,362 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2015-03-13 10:12:21,363 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 151000
2015-03-13 10:12:21,364 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2015-03-13 10:12:21,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,372 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,373 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,374 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,377 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:21,378 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2015-03-13 10:12:21,379 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 165000
2015-03-13 10:12:21,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2015-03-13 10:12:21,381 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 139000
2015-03-13 10:12:21,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2015-03-13 10:12:21,383 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 117000
2015-03-13 10:12:21,384 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2015-03-13 10:12:21,385 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 107000
2015-03-13 10:12:21,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2015-03-13 10:12:21,386 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch
2015-03-13 10:12:21,386 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,387 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch dst=null perm=null
2015-03-13 10:12:21,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2015-03-13 10:12:21,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00000 dst=null perm=null
2015-03-13 10:12:21,390 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 32, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329, duration: 131000
2015-03-13 10:12:21,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2015-03-13 10:12:21,391 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00001 dst=null perm=null
2015-03-13 10:12:21,393 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327, duration: 140000
2015-03-13 10:12:21,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2015-03-13 10:12:21,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00002 dst=null perm=null
2015-03-13 10:12:21,395 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63202, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330, duration: 153000
2015-03-13 10:12:21,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2015-03-13 10:12:21,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00003 dst=null perm=null
2015-03-13 10:12:21,398 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 18, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328, duration: 115000
2015-03-13 10:12:21,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2015-03-13 10:12:21,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinfilteredbranch/part-00004 dst=null perm=null
2015-03-13 10:12:21,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:21,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:21,410 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,411 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:12:21,411 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:12:21,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:12:21,436 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting
2015-03-13 10:12:21,436 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:12:21,436 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:12:21,436 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:12:21,436 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin"]
2015-03-13 10:12:21,437 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] parallel execution is enabled: true
2015-03-13 10:12:21,437 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] starting jobs: 3
2015-03-13 10:12:21,437 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper1*upper2] allocating threads: 3
2015-03-13 10:12:21,438 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (3/3)
2015-03-13 10:12:21,445 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,453 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:21,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:21,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:21,457 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 28
2015-03-13 10:12:21,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=null
2015-03-13 10:12:21,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:21,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:12:21,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,462 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,463 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:21,465 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63204 dest: /127.0.0.1:60689
2015-03-13 10:12:21,466 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63205 dest: /127.0.0.1:60693
2015-03-13 10:12:21,467 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63206 dest: /127.0.0.1:60696
2015-03-13 10:12:21,470 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63206, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 1875000
2015-03-13 10:12:21,471 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,471 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,471 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63205, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 2186000
2015-03-13 10:12:21,471 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,472 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,472 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63204, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 3495000
2015-03-13 10:12:21,472 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,473 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742158_1334{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:21,474 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,475 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar
2015-03-13 10:12:21,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:21,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:21,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:21,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:12:21,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:12:21,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:12:21,481 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:12:21,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:12:21,482 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:21,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:21,484 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:21,485 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:21,486 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,488 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split
2015-03-13 10:12:21,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,489 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,490 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63207 dest: /127.0.0.1:60696
2015-03-13 10:12:21,491 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63208 dest: /127.0.0.1:60689
2015-03-13 10:12:21,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63209 dest: /127.0.0.1:60693
2015-03-13 10:12:21,493 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335 src: /127.0.0.1:63210 dest: /127.0.0.1:60686
2015-03-13 10:12:21,496 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63210, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 1776000
2015-03-13 10:12:21,496 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,497 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,497 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63209, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 2040000
2015-03-13 10:12:21,497 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,497 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,498 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63208, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 3069000
2015-03-13 10:12:21,498 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,498 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,498 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63207, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 3444000
2015-03-13 10:12:21,499 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,499 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742159_1335{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,500 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,503 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,504 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,505 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63211 dest: /127.0.0.1:60696
2015-03-13 10:12:21,506 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63212 dest: /127.0.0.1:60689
2015-03-13 10:12:21,507 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336 src: /127.0.0.1:63213 dest: /127.0.0.1:60686
2015-03-13 10:12:21,509 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63213, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 1233000
2015-03-13 10:12:21,510 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,510 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,510 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63212, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 1751000
2015-03-13 10:12:21,510 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,510 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,511 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63211, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 2541000
2015-03-13 10:12:21,511 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,511 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742160_1336{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,512 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,512 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:21,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:21,516 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:21,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:21,517 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:21,522 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:21,523 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63214 dest: /127.0.0.1:60693
2015-03-13 10:12:21,524 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63215 dest: /127.0.0.1:60696
2015-03-13 10:12:21,526 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337 src: /127.0.0.1:63216 dest: /127.0.0.1:60686
2015-03-13 10:12:21,529 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63216, dest: /127.0.0.1:60686, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 1416000
2015-03-13 10:12:21,529 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:21,529 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,529 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63215, dest: /127.0.0.1:60696, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 1964000
2015-03-13 10:12:21,530 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,530 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,530 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63214, dest: /127.0.0.1:60693, bytes: 96469, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 2829000
2015-03-13 10:12:21,530 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:21,531 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742161_1337{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:21,532 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:21,532 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0028
2015-03-13 10:12:21,533 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=null
2015-03-13 10:12:21,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:21,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:21,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:21,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:21,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:21,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:21,546 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:21,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:21,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:21,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:21,549 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 28 submitted by user soberoi
2015-03-13 10:12:21,549 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0028
2015-03-13 10:12:21,549 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0028
2015-03-13 10:12:21,549 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0028
2015-03-13 10:12:21,549 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from NEW to NEW_SAVING
2015-03-13 10:12:21,549 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:21,549 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,549 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:21,550 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0028 from user: soberoi activated in queue: default
2015-03-13 10:12:21,550 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0028 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:21,550 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0028 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:21,550 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0028 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:21,550 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0028_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:21,550 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:21,551 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:21,552 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0028/
2015-03-13 10:12:21,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0028
2015-03-13 10:12:21,552 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0028/
2015-03-13 10:12:21,748 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:21,748 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:21,748 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:21,748 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0028_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,749 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:21,749 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:21,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:21,752 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0028 AttemptId: appattempt_1426266260362_0028_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:12:21,752 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:21,752 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,752 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:21,752 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0028_000001
2015-03-13 10:12:21,753 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,753 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0028_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:12:21,755 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:21,756 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000001 by user soberoi
2015-03-13 10:12:21,757 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0028
2015-03-13 10:12:21,757 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:21,757 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from NEW to INITING
2015-03-13 10:12:21,757 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000001 to application application_1426266260362_0028
2015-03-13 10:12:21,757 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0028_000001
2015-03-13 10:12:21,757 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from INITING to RUNNING
2015-03-13 10:12:21,757 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:21,757 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:21,757 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:21,758 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:21,758 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:21,758 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000001
2015-03-13 10:12:21,768 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0028_01_000001.tokens. Credentials list:
2015-03-13 10:12:21,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:21,851 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/nmPrivate/container_1426266260362_0028_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001.tokens
2015-03-13 10:12:21,852 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:21,910 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,911 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:21,918 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63200, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 503000
2015-03-13 10:12:21,936 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:21,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:21,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:21,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:21,958 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 144000
2015-03-13 10:12:21,971 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:21,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,987 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:21,995 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63201, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 143000
2015-03-13 10:12:22,008 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:22,027 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:22,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:22,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:22,034 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63199, bytes: 97225, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340277465_14925, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 231000
2015-03-13 10:12:22,048 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:22,048 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:22,064 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742158_1334 to datanode(s) 127.0.0.1:60686
2015-03-13 10:12:22,064 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742150_1326]
2015-03-13 10:12:22,064 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742148_1324, blk_1073742149_1325, blk_1073742150_1326, blk_1073742141_1317]
2015-03-13 10:12:22,075 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:22,075 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:22,148 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001/default_container_executor.sh]
2015-03-13 10:12:22,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:22,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:22,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:22,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:22,628 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:22,629 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:22,631 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:22,631 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:22,630 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:22,631 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:22,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:22,749 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:22,761 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,021 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 to 127.0.0.1:60686
2015-03-13 10:12:23,022 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63220 dest: /127.0.0.1:60686
2015-03-13 10:12:23,022 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 (numBytes=254067) to /127.0.0.1:60686
2015-03-13 10:12:23,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334 src: /127.0.0.1:63220 dest: /127.0.0.1:60686 of size 254067
2015-03-13 10:12:23,024 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742158_1334 size 254067
2015-03-13 10:12:23,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:23,749 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,749 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED dst=null perm=null
2015-03-13 10:12:23,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:12:23,751 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_FAIL dst=null perm=null
2015-03-13 10:12:23,761 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:23,802 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=null
2015-03-13 10:12:23,803 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:12:23,804 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:12:24,092 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:24,099 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:24,155 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63222, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336, duration: 190000
2015-03-13 10:12:24,755 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:24,765 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:24,800 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742151_1327
2015-03-13 10:12:24,800 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:24,800 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742153_1329
2015-03-13 10:12:24,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742156_1332
2015-03-13 10:12:24,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742152_1328
2015-03-13 10:12:24,801 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331
2015-03-13 10:12:24,930 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:24,931 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0028_000001
2015-03-13 10:12:24,931 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0028 APPATTEMPTID=appattempt_1426266260362_0028_000001
2015-03-13 10:12:24,932 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:24,932 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from ACCEPTED to RUNNING
2015-03-13 10:12:24,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:24,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:25,004 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,005 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742154_1330
2015-03-13 10:12:25,005 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:25,006 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742157_1333
2015-03-13 10:12:25,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:25,066 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742147_1323, blk_1073742148_1324, blk_1073742149_1325, blk_1073742141_1317]
2015-03-13 10:12:25,066 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742145_1321, blk_1073742146_1322, blk_1073742148_1324, blk_1073742149_1325, blk_1073742150_1326, blk_1073742141_1317]
2015-03-13 10:12:25,137 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:25,184 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63228 dest: /127.0.0.1:60689
2015-03-13 10:12:25,185 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63229 dest: /127.0.0.1:60693
2015-03-13 10:12:25,186 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338 src: /127.0.0.1:63230 dest: /127.0.0.1:60696
2015-03-13 10:12:25,193 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63230, dest: /127.0.0.1:60696, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 5242000
2015-03-13 10:12:25,193 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:25,193 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,194 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63229, dest: /127.0.0.1:60693, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 6117000
2015-03-13 10:12:25,194 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:25,194 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,195 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63228, dest: /127.0.0.1:60689, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 6911000
2015-03-13 10:12:25,195 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:25,195 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742162_1338{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:25,198 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:25,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:25,758 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:25,764 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,764 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:25,766 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:25,820 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:25,821 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:25,822 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:25,849 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147 for deletion
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:25,850 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:25,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:25,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742147_1323 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742147
2015-03-13 10:12:25,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:25,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:25,851 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:25,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:25,963 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:26,024 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145 for deletion
2015-03-13 10:12:26,024 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146 for deletion
2015-03-13 10:12:26,024 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148 for deletion
2015-03-13 10:12:26,024 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742145_1321 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742145
2015-03-13 10:12:26,024 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149 for deletion
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150 for deletion
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742148_1324 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742148
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742146_1322 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742146
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141 for deletion
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742150_1326 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742150
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742149_1325 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742149
2015-03-13 10:12:26,025 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742141_1317 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742141
2015-03-13 10:12:26,158 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,159 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:26,159 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:26,159 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,159 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:26,159 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,160 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,160 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:26,160 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:26,160 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,160 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:26,161 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,161 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,161 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:26,161 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:26,161 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,161 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:26,162 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,162 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:26,162 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:26,162 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0028_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,162 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:26,162 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,337 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0027_01_000001 succeeded
2015-03-13 10:12:26,337 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:26,337 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0027_01_000001
2015-03-13 10:12:26,343 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,343 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027/container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:26,344 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0027_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:26,344 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0027_01_000001 from application application_1426266260362_0027
2015-03-13 10:12:26,344 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:26,344 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0027
2015-03-13 10:12:26,360 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335
2015-03-13 10:12:26,361 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337
2015-03-13 10:12:26,362 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:26,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334
2015-03-13 10:12:26,563 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742160_1336
2015-03-13 10:12:26,761 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:26,762 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:26,762 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:26,763 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:26,763 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0028 container=Container: [ContainerId: container_1426266260362_0028_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0028_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,763 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:26,763 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 27 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:26,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0027_01_000001
2015-03-13 10:12:26,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0027_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:26,767 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0027_000001
2015-03-13 10:12:26,767 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0027_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:26,768 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0027_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:26,768 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0027 CONTAINERID=container_1426266260362_0027_01_000001
2015-03-13 10:12:26,768 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0027 State change from FINISHING to FINISHED
2015-03-13 10:12:26,768 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0027_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:26,768 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0027_000001
2015-03-13 10:12:26,768 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:26,768 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0027
2015-03-13 10:12:26,768 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0027_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,768 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0027,name=[D22FDB06DDD24032BF29C6EAE9E54D4B/55AECEF510524BE28EDC4742DCE94B2F] lower*upper/(1/2) ...atform/joinfilteredbranch,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0027/jobhistory/job/job_1426266260362_0027,appMasterHost=Edinburgh.local,startTime=1426266725092,finishTime=1426266740298,finalStatus=SUCCEEDED
2015-03-13 10:12:26,768 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:26,769 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:26,769 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0027_000001 released container container_1426266260362_0027_01_000001 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:26,769 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0027_000001 is done. finalState=FINISHED
2015-03-13 10:12:26,769 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0027 requests cleared
2015-03-13 10:12:26,769 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0027 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:26,769 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0027 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:26,770 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0027_000001 (auth:SIMPLE)
2015-03-13 10:12:26,771 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0027_01_000001
2015-03-13 10:12:26,962 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:26,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:26,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:26,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:26,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:27,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:27,002 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:27,007 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:27,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:27,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:27,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:27,086 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:27,086 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:27,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000006 by user soberoi
2015-03-13 10:12:27,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000004 by user soberoi
2015-03-13 10:12:27,089 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:27,090 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000005 by user soberoi
2015-03-13 10:12:27,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:27,090 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000003 by user soberoi
2015-03-13 10:12:27,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:27,090 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0028_01_000002 by user soberoi
2015-03-13 10:12:27,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0028
2015-03-13 10:12:27,090 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000005 to application application_1426266260362_0028
2015-03-13 10:12:27,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:27,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:27,090 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000006 to application application_1426266260362_0028
2015-03-13 10:12:27,091 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,091 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,091 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,091 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,091 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000003 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000002 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,092 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from NEW to INITING
2015-03-13 10:12:27,092 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0028_01_000004 to application application_1426266260362_0028
2015-03-13 10:12:27,092 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from INITING to RUNNING
2015-03-13 10:12:27,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:27,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,093 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,093 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,093 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:27,093 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:27,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0028
2015-03-13 10:12:27,094 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:27,094 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0028
2015-03-13 10:12:27,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000005
2015-03-13 10:12:27,095 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000002
2015-03-13 10:12:27,098 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000003
2015-03-13 10:12:27,100 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0028_01_000004
2015-03-13 10:12:27,117 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0028_01_000005.tokens. Credentials list:
2015-03-13 10:12:27,120 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0028_01_000002.tokens. Credentials list:
2015-03-13 10:12:27,122 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0028_01_000004.tokens. Credentials list:
2015-03-13 10:12:27,122 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0028_01_000003.tokens. Credentials list:
2015-03-13 10:12:27,132 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,133 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,136 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:27,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,161 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,162 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:27,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,162 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0027
2015-03-13 10:12:27,162 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,162 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,162 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:27,163 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0027, with delay of 10800 seconds
2015-03-13 10:12:27,205 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006/default_container_executor.sh]
2015-03-13 10:12:27,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0028_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005.tokens
2015-03-13 10:12:27,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:27,285 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:27,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:27,286 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar dst=null perm=null
2015-03-13 10:12:27,293 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63236, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_83666383_15058, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742158_1334, duration: 526000
2015-03-13 10:12:27,317 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:27,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:27,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:27,337 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml dst=null perm=null
2015-03-13 10:12:27,343 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63237, bytes: 97225, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_83666383_15058, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742161_1337, duration: 305000
2015-03-13 10:12:27,362 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:27,362 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,362 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:27,430 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,430 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,430 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,430 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,437 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:27,437 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:27,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002/default_container_executor.sh]
2015-03-13 10:12:27,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003/default_container_executor.sh]
2015-03-13 10:12:27,557 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005/default_container_executor.sh]
2015-03-13 10:12:27,582 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004/default_container_executor.sh]
2015-03-13 10:12:27,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,767 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:27,767 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:27,767 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:27,768 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0027
2015-03-13 10:12:27,768 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0027 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:27,768 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0027, with delay of 10800 seconds
2015-03-13 10:12:27,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,768 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,769 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0027
2015-03-13 10:12:27,976 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:12:28,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,167 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,401 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:28,547 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0028_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004.tokens
2015-03-13 10:12:28,547 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:28,649 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:28,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,768 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:28,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0028_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003.tokens
2015-03-13 10:12:28,783 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:28,884 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:29,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0028_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002.tokens
2015-03-13 10:12:29,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:29,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,770 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:29,771 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,014 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338
2015-03-13 10:12:30,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,178 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,776 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:30,776 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,183 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,781 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:31,781 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,184 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,185 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:32,786 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,186 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,187 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,788 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:33,789 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,193 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,790 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,791 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:34,907 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:35,078 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63247, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 153000
2015-03-13 10:12:35,195 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,196 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:35,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:35,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:35,284 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63250, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 146000
2015-03-13 10:12:35,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:35,355 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,422 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63252, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 148000
2015-03-13 10:12:35,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job.split dst=null perm=null
2015-03-13 10:12:35,448 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63253, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 165000
2015-03-13 10:12:35,490 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63255, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 185000
2015-03-13 10:12:35,571 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:35,583 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63256, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742159_1335, duration: 149000
2015-03-13 10:12:35,598 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:35,602 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63257, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 147000
2015-03-13 10:12:35,612 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,619 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:35,625 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63258, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:12:35,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,703 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:35,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:35,718 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63260, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 146000
2015-03-13 10:12:35,746 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63259 dest: /127.0.0.1:60686
2015-03-13 10:12:35,748 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63261 dest: /127.0.0.1:60693
2015-03-13 10:12:35,749 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339 src: /127.0.0.1:63262 dest: /127.0.0.1:60696
2015-03-13 10:12:35,764 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63262, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 13901000
2015-03-13 10:12:35,765 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:35,765 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,765 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63261, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 14517000
2015-03-13 10:12:35,766 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:35,766 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,766 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63259, dest: /127.0.0.1:60686, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 15494000
2015-03-13 10:12:35,766 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:35,767 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742163_1339{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:35,771 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0028_m_000004_0_-1857110520_1
2015-03-13 10:12:35,783 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0 dst=null perm=null
2015-03-13 10:12:35,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0 dst=null perm=null
2015-03-13 10:12:35,792 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,792 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004 dst=null perm=null
2015-03-13 10:12:35,796 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000004_0 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:35,818 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:35,818 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000006
2015-03-13 10:12:35,818 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:35,818 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:35,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:35,826 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:35,831 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000006 is : 143
2015-03-13 10:12:35,831 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:35,833 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63263 dest: /127.0.0.1:60689
2015-03-13 10:12:35,834 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63264 dest: /127.0.0.1:60696
2015-03-13 10:12:35,836 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340 src: /127.0.0.1:63265 dest: /127.0.0.1:60686
2015-03-13 10:12:35,840 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist for DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:35,843 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:35,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000006
2015-03-13 10:12:35,844 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:35,845 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:35,845 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000006 from application application_1426266260362_0028
2015-03-13 10:12:35,845 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:35,846 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:35,973 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:36,034 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63266, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 156000
2015-03-13 10:12:36,053 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:36,091 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,093 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63267 dest: /127.0.0.1:60696
2015-03-13 10:12:36,095 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63268 dest: /127.0.0.1:60686
2015-03-13 10:12:36,096 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341 src: /127.0.0.1:63270 dest: /127.0.0.1:60693
2015-03-13 10:12:36,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63270, dest: /127.0.0.1:60693, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 6108000
2015-03-13 10:12:36,104 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63268, dest: /127.0.0.1:60686, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 6936000
2015-03-13 10:12:36,105 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,105 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63267, dest: /127.0.0.1:60696, bytes: 114, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 7889000
2015-03-13 10:12:36,106 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,106 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742165_1341{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,110 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0028_m_000000_0_1207470100_1
2015-03-13 10:12:36,121 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0 dst=null perm=null
2015-03-13 10:12:36,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0 dst=null perm=null
2015-03-13 10:12:36,131 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000 dst=null perm=null
2015-03-13 10:12:36,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000000_0 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,135 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63269 dest: /127.0.0.1:60686
2015-03-13 10:12:36,137 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63271 dest: /127.0.0.1:60696
2015-03-13 10:12:36,138 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342 src: /127.0.0.1:63272 dest: /127.0.0.1:60689
2015-03-13 10:12:36,146 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63272, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 5987000
2015-03-13 10:12:36,146 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,147 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63271, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 6818000
2015-03-13 10:12:36,147 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,147 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,148 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63269, dest: /127.0.0.1:60686, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 7904000
2015-03-13 10:12:36,148 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,148 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742166_1342{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,153 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0028_m_000002_0_1251486514_1
2015-03-13 10:12:36,153 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,153 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000002
2015-03-13 10:12:36,153 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,154 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,156 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,166 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000002 is : 143
2015-03-13 10:12:36,174 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0 dst=null perm=null
2015-03-13 10:12:36,178 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,178 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,179 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,179 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,179 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000002 from application application_1426266260362_0028
2015-03-13 10:12:36,179 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,179 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,179 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000002
2015-03-13 10:12:36,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0 dst=null perm=null
2015-03-13 10:12:36,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002 dst=null perm=null
2015-03-13 10:12:36,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000002_0 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,200 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,200 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000004
2015-03-13 10:12:36,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000002
2015-03-13 10:12:36,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,201 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,201 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,201 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000002
2015-03-13 10:12:36,202 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:36,202 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:36,202 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,202 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,202 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:36,202 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:36,210 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63273 dest: /127.0.0.1:60693
2015-03-13 10:12:36,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63274 dest: /127.0.0.1:60696
2015-03-13 10:12:36,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343 src: /127.0.0.1:63275 dest: /127.0.0.1:60689
2015-03-13 10:12:36,213 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000004 is : 143
2015-03-13 10:12:36,220 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63275, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 6258000
2015-03-13 10:12:36,220 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,221 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63274, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 7390000
2015-03-13 10:12:36,221 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,222 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63273, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 8114000
2015-03-13 10:12:36,222 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,222 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,223 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742167_1343{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,224 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,225 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,226 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000004 from application application_1426266260362_0028
2015-03-13 10:12:36,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,226 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,226 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,226 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000004
2015-03-13 10:12:36,230 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0028_m_000001_0_-2295557_1
2015-03-13 10:12:36,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0 dst=null perm=null
2015-03-13 10:12:36,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0 dst=null perm=null
2015-03-13 10:12:36,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001 dst=null perm=null
2015-03-13 10:12:36,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000001_0 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,255 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000003
2015-03-13 10:12:36,255 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,255 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,256 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000003
2015-03-13 10:12:36,256 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,256 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,256 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000004
2015-03-13 10:12:36,256 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,256 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,257 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,257 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000004
2015-03-13 10:12:36,257 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:36,257 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:36,257 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,257 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,257 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:36,257 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:36,267 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:36,268 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000003 is : 143
2015-03-13 10:12:36,279 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,280 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,280 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,280 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000003 from application application_1426266260362_0028
2015-03-13 10:12:36,280 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,280 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,280 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,281 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,281 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000003
2015-03-13 10:12:36,305 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63276 dest: /127.0.0.1:60696
2015-03-13 10:12:36,306 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63277 dest: /127.0.0.1:60689
2015-03-13 10:12:36,307 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344 src: /127.0.0.1:63278 dest: /127.0.0.1:60693
2015-03-13 10:12:36,314 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63278, dest: /127.0.0.1:60693, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 5835000
2015-03-13 10:12:36,314 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,315 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,315 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63277, dest: /127.0.0.1:60689, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 6561000
2015-03-13 10:12:36,315 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,316 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,316 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63276, dest: /127.0.0.1:60696, bytes: 92, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 7417000
2015-03-13 10:12:36,316 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,316 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742168_1344{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:36,320 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0028_m_000003_0_1592380672_1
2015-03-13 10:12:36,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0 dst=null perm=null
2015-03-13 10:12:36,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0 dst=null perm=null
2015-03-13 10:12:36,344 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003 dst=null perm=null
2015-03-13 10:12:36,351 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/_temporary/attempt_1426266260362_0028_m_000003_0 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:36,361 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:36,361 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000005
2015-03-13 10:12:36,361 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,361 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000003
2015-03-13 10:12:36,361 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:36,362 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,362 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,362 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000003
2015-03-13 10:12:36,362 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:36,362 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:36,362 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,362 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,362 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:36,362 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:36,366 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,368 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,372 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1 dst=null perm=null
2015-03-13 10:12:36,373 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0028_01_000005 is : 143
2015-03-13 10:12:36,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,381 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000 dst=null perm=null
2015-03-13 10:12:36,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000 dst=null perm=null
2015-03-13 10:12:36,384 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:36,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,385 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000000/part-00000 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,385 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:36,386 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:36,387 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000005 from application application_1426266260362_0028
2015-03-13 10:12:36,387 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:36,387 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:36,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,389 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001 dst=null perm=null
2015-03-13 10:12:36,390 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001 dst=null perm=null
2015-03-13 10:12:36,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000001/part-00001 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,392 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,393 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002 dst=null perm=null
2015-03-13 10:12:36,394 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002 dst=null perm=null
2015-03-13 10:12:36,395 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000002/part-00002 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,397 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003 dst=null perm=null
2015-03-13 10:12:36,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003 dst=null perm=null
2015-03-13 10:12:36,399 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000003/part-00003 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,400 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:36,401 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004 dst=null perm=null
2015-03-13 10:12:36,402 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004 dst=null perm=null
2015-03-13 10:12:36,403 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary/1/task_1426266260362_0028_m_000004/part-00004 dst=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_temporary dst=null perm=null
2015-03-13 10:12:36,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,412 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,414 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,415 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,429 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63265, dest: /127.0.0.1:60686, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 591891000
2015-03-13 10:12:36,429 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,430 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,430 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63264, dest: /127.0.0.1:60696, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 593022000
2015-03-13 10:12:36,431 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,432 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,432 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63263, dest: /127.0.0.1:60689, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 594584000
2015-03-13 10:12:36,432 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,432 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742164_1340{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:36,434 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,439 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,442 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:36,443 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63279 dest: /127.0.0.1:60693
2015-03-13 10:12:36,445 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63280 dest: /127.0.0.1:60686
2015-03-13 10:12:36,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345 src: /127.0.0.1:63281 dest: /127.0.0.1:60696
2015-03-13 10:12:36,448 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63281, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 1133000
2015-03-13 10:12:36,448 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63280, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 1588000
2015-03-13 10:12:36,449 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,449 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,449 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63279, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 2273000
2015-03-13 10:12:36,450 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,450 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742169_1345{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,451 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist dst=null perm=null
2015-03-13 10:12:36,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:36,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist dst=null perm=null
2015-03-13 10:12:36,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:36,468 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1.jhist dst=null perm=null
2015-03-13 10:12:36,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,474 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63282, bytes: 53732, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340, duration: 188000
2015-03-13 10:12:36,476 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:36,478 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63283 dest: /127.0.0.1:60696
2015-03-13 10:12:36,479 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63284 dest: /127.0.0.1:60686
2015-03-13 10:12:36,480 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346 src: /127.0.0.1:63285 dest: /127.0.0.1:60689
2015-03-13 10:12:36,484 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63285, dest: /127.0.0.1:60689, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 1890000
2015-03-13 10:12:36,484 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,484 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,484 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63284, dest: /127.0.0.1:60686, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 2505000
2015-03-13 10:12:36,485 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,485 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,485 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63283, dest: /127.0.0.1:60696, bytes: 53312, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, duration: 3277000
2015-03-13 10:12:36,485 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,486 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742170_1346{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:36,487 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,488 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml dst=null perm=null
2015-03-13 10:12:36,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:36,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml dst=null perm=null
2015-03-13 10:12:36,491 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:36,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028/job_1426266260362_0028_1_conf.xml dst=null perm=null
2015-03-13 10:12:36,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:36,498 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63282, bytes: 90073, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742162_1338, duration: 268000
2015-03-13 10:12:36,499 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:36,501 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63286 dest: /127.0.0.1:60689
2015-03-13 10:12:36,502 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63287 dest: /127.0.0.1:60693
2015-03-13 10:12:36,504 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347 src: /127.0.0.1:63288 dest: /127.0.0.1:60696
2015-03-13 10:12:36,506 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63288, dest: /127.0.0.1:60696, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 1498000
2015-03-13 10:12:36,507 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:36,507 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,507 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63287, dest: /127.0.0.1:60693, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 2213000
2015-03-13 10:12:36,507 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,508 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,508 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63286, dest: /127.0.0.1:60689, bytes: 89373, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_308547630_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, duration: 2897000
2015-03-13 10:12:36,508 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:36,509 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742171_1347{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:36,510 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_308547630_1
2015-03-13 10:12:36,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,513 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:36,524 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:36,524 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0028
2015-03-13 10:12:36,524 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from RUNNING to REMOVING
2015-03-13 10:12:36,524 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0028
2015-03-13 10:12:36,525 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from REMOVING to FINISHING
2015-03-13 10:12:36,567 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339
2015-03-13 10:12:36,568 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:36,568 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:36,568 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340
2015-03-13 10:12:36,569 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:36,569 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:36,570 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:36,570 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:36,570 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:36,819 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:36,820 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:36,820 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000006
2015-03-13 10:12:36,820 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:36,820 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:36,821 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000006
2015-03-13 10:12:36,821 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:36,821 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:36,821 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,821 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:36,821 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:36,822 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000006 on node: host: 10.1.1.144:60723 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:37,362 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:37,362 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000005
2015-03-13 10:12:37,362 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:37,362 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:37,363 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000005
2015-03-13 10:12:37,363 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:37,363 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:37,363 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,363 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,363 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:37,363 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:37,536 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742158_1334 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:12:37,536 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742159_1335 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:12:37,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742160_1336 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:12:37,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742161_1337 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:12:37,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742164_1340 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:12:37,537 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742162_1338 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:12:37,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0028 dst=null perm=null
2015-03-13 10:12:37,562 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (2/3)
2015-03-13 10:12:37,571 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,578 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:37,581 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:37,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:37,584 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 29
2015-03-13 10:12:37,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=null
2015-03-13 10:12:37,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:37,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:12:37,587 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,589 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:37,590 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63292 dest: /127.0.0.1:60696
2015-03-13 10:12:37,591 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63293 dest: /127.0.0.1:60693
2015-03-13 10:12:37,592 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63294 dest: /127.0.0.1:60686
2015-03-13 10:12:37,596 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63294, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 2524000
2015-03-13 10:12:37,596 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,596 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,597 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63293, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 2680000
2015-03-13 10:12:37,597 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,597 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,597 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63292, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 3421000
2015-03-13 10:12:37,597 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,598 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742172_1348{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,599 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,600 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar
2015-03-13 10:12:37,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:37,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:37,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:37,603 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:12:37,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:12:37,604 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:12:37,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:12:37,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:12:37,606 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:37,607 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:37,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:37,608 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:12:37,610 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:12:37,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,614 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split
2015-03-13 10:12:37,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:37,615 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:37,617 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63295 dest: /127.0.0.1:60693
2015-03-13 10:12:37,618 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63296 dest: /127.0.0.1:60686
2015-03-13 10:12:37,619 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63297 dest: /127.0.0.1:60689
2015-03-13 10:12:37,621 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349 src: /127.0.0.1:63298 dest: /127.0.0.1:60696
2015-03-13 10:12:37,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63298, dest: /127.0.0.1:60696, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 1527000
2015-03-13 10:12:37,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,624 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63297, dest: /127.0.0.1:60689, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 1973000
2015-03-13 10:12:37,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,625 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,625 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63296, dest: /127.0.0.1:60686, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 2865000
2015-03-13 10:12:37,625 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,626 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,626 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63295, dest: /127.0.0.1:60693, bytes: 1737, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 3609000
2015-03-13 10:12:37,626 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,627 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742173_1349{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:37,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,629 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,631 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:37,633 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63299 dest: /127.0.0.1:60689
2015-03-13 10:12:37,634 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63300 dest: /127.0.0.1:60686
2015-03-13 10:12:37,635 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350 src: /127.0.0.1:63301 dest: /127.0.0.1:60693
2015-03-13 10:12:37,637 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63301, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 1182000
2015-03-13 10:12:37,637 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,638 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,638 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63300, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 1649000
2015-03-13 10:12:37,638 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,638 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,639 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63299, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 2331000
2015-03-13 10:12:37,639 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,639 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742174_1350{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:37,640 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,640 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:37,641 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,643 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:37,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:37,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:37,644 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:37,647 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:37,648 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63302 dest: /127.0.0.1:60696
2015-03-13 10:12:37,650 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63303 dest: /127.0.0.1:60693
2015-03-13 10:12:37,651 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351 src: /127.0.0.1:63304 dest: /127.0.0.1:60686
2015-03-13 10:12:37,653 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63304, dest: /127.0.0.1:60686, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 1453000
2015-03-13 10:12:37,653 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:37,654 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,654 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63303, dest: /127.0.0.1:60693, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 1721000
2015-03-13 10:12:37,654 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,654 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,655 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63302, dest: /127.0.0.1:60696, bytes: 97792, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 2393000
2015-03-13 10:12:37,655 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:37,655 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742175_1351{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:37,656 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:37,656 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0029
2015-03-13 10:12:37,657 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=null
2015-03-13 10:12:37,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:37,658 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:37,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:37,660 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:37,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:37,661 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:37,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:37,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:37,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:37,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:37,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:37,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:37,667 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 29 submitted by user soberoi
2015-03-13 10:12:37,667 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0029
2015-03-13 10:12:37,667 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from NEW to NEW_SAVING
2015-03-13 10:12:37,667 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0029
2015-03-13 10:12:37,667 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0029
2015-03-13 10:12:37,668 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:37,668 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,668 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:37,668 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0029 from user: soberoi activated in queue: default
2015-03-13 10:12:37,668 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0029 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:37,668 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0029 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:37,668 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0029 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:37,669 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0029_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:37,669 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:37,670 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:37,671 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0029/
2015-03-13 10:12:37,672 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0029
2015-03-13 10:12:37,672 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0029/
2015-03-13 10:12:37,789 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:37,789 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:37,789 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:12:37,790 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0029_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,790 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:37,790 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:37,790 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:37,791 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0029 AttemptId: appattempt_1426266260362_0029_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:37,791 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:37,791 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,791 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:37,791 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0029_000001
2015-03-13 10:12:37,792 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,792 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0029_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:12:37,794 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:37,795 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000001 by user soberoi
2015-03-13 10:12:37,795 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0029
2015-03-13 10:12:37,795 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:37,795 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from NEW to INITING
2015-03-13 10:12:37,796 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000001 to application application_1426266260362_0029
2015-03-13 10:12:37,796 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from INITING to RUNNING
2015-03-13 10:12:37,796 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0029_000001
2015-03-13 10:12:37,796 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:37,796 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:37,796 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:37,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,796 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,797 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:37,797 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000001
2015-03-13 10:12:37,813 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0029_01_000001.tokens. Credentials list:
2015-03-13 10:12:37,820 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:37,829 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:37,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0029_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001.tokens
2015-03-13 10:12:37,899 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:37,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:37,968 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63308, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 492000
2015-03-13 10:12:37,987 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:38,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:38,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:38,011 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63309, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 159000
2015-03-13 10:12:38,023 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,039 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:38,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:38,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:38,046 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63308, bytes: 1753, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 149000
2015-03-13 10:12:38,059 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,078 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:38,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:38,079 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:38,086 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63310, bytes: 98556, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1180023147_15416, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 269000
2015-03-13 10:12:38,100 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:38,100 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:38,128 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:38,128 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:38,197 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001/default_container_executor.sh]
2015-03-13 10:12:38,790 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:38,791 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:38,821 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:39,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED dst=null perm=null
2015-03-13 10:12:39,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:12:39,768 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_FAIL dst=null perm=null
2015-03-13 10:12:39,792 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,821 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:39,822 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=null
2015-03-13 10:12:39,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:12:39,824 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:12:40,020 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:40,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:40,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:40,021 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:40,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:40,022 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,023 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742164_1340
2015-03-13 10:12:40,084 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742172_1348 to datanode(s) 127.0.0.1:60689
2015-03-13 10:12:40,084 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742160_1336, blk_1073742162_1338, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:40,085 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:40,112 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:40,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:40,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63312, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350, duration: 185000
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:40,643 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:40,645 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:40,645 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:40,644 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:40,645 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:40,792 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:40,826 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:40,830 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,830 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,831 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343
2015-03-13 10:12:40,831 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:40,831 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:40,832 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742171_1347
2015-03-13 10:12:40,863 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 to 127.0.0.1:60689
2015-03-13 10:12:40,865 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:12:40,866 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63315 dest: /127.0.0.1:60689
2015-03-13 10:12:40,867 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348 src: /127.0.0.1:63315 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:12:40,868 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742172_1348 size 254067
2015-03-13 10:12:40,926 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:40,928 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0029_000001
2015-03-13 10:12:40,928 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0029 APPATTEMPTID=appattempt_1426266260362_0029_000001
2015-03-13 10:12:40,928 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:40,928 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from ACCEPTED to RUNNING
2015-03-13 10:12:40,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:40,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:40,976 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345
2015-03-13 10:12:40,976 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:40,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341
2015-03-13 10:12:40,977 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:40,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:40,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742174_1350
2015-03-13 10:12:40,979 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342
2015-03-13 10:12:41,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:41,037 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:41,134 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:41,170 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63319 dest: /127.0.0.1:60686
2015-03-13 10:12:41,171 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63320 dest: /127.0.0.1:60693
2015-03-13 10:12:41,173 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352 src: /127.0.0.1:63321 dest: /127.0.0.1:60689
2015-03-13 10:12:41,180 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742170_1346
2015-03-13 10:12:41,181 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63321, dest: /127.0.0.1:60689, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 6395000
2015-03-13 10:12:41,181 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:41,183 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63320, dest: /127.0.0.1:60693, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 8537000
2015-03-13 10:12:41,183 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:41,183 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,185 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63319, dest: /127.0.0.1:60686, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 9940000
2015-03-13 10:12:41,185 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,185 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:41,185 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742176_1352{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:41,189 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 2954 Total time for transactions(ms): 131 Number of transactions batched in Syncs: 5 Number of syncs: 1683 SyncTimes(ms): 475 382
2015-03-13 10:12:41,189 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:41,234 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:41,235 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:41,235 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344
2015-03-13 10:12:41,577 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351
2015-03-13 10:12:41,577 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349
2015-03-13 10:12:41,781 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:41,793 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:41,832 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:42,375 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,376 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:42,376 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:42,376 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,376 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:42,376 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,377 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,377 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:42,377 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:42,378 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,378 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:42,378 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,379 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,379 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:42,379 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:42,379 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,379 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:42,379 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,380 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:42,380 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:42,380 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0029_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,380 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:42,380 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,673 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0028_01_000001 succeeded
2015-03-13 10:12:42,673 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:42,674 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:42,680 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0028_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:42,680 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0028_01_000001 from application application_1426266260362_0028
2015-03-13 10:12:42,681 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:42,681 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0028
2015-03-13 10:12:42,680 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028/container_1426266260362_0028_01_000001
2015-03-13 10:12:42,794 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:42,795 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:42,795 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:42,795 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:12:42,795 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0029 container=Container: [ContainerId: container_1426266260362_0029_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0029_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,795 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:42,796 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,834 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 28 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:42,835 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0028_01_000001
2015-03-13 10:12:42,835 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0028_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:42,835 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0028_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:42,835 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0028_000001
2015-03-13 10:12:42,835 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0028 CONTAINERID=container_1426266260362_0028_01_000001
2015-03-13 10:12:42,836 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0028_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:42,836 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0028_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:42,836 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0028 State change from FINISHING to FINISHED
2015-03-13 10:12:42,836 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:42,836 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0028_000001
2015-03-13 10:12:42,836 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0028
2015-03-13 10:12:42,836 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0028_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,837 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0028,name=[B61955F7F1A34D09B0265BE65DDD3B28/31E34ADFFB5F45C187BD485C865354E1] lower*upper1*upper2/(3/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0028/jobhistory/job/job_1426266260362_0028,appMasterHost=Edinburgh.local,startTime=1426266741548,finishTime=1426266756525,finalStatus=SUCCEEDED
2015-03-13 10:12:42,837 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:42,837 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:42,837 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0028_000001 released container container_1426266260362_0028_01_000001 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:42,837 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0028_000001 is done. finalState=FINISHED
2015-03-13 10:12:42,837 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0028 requests cleared
2015-03-13 10:12:42,837 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0028 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:42,838 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0028 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:42,839 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0028_000001 (auth:SIMPLE)
2015-03-13 10:12:42,840 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0028_01_000001
2015-03-13 10:12:42,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:42,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:42,991 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:43,000 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:43,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:43,003 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:43,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:43,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:43,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:43,012 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:43,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:43,085 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742161_1337, blk_1073742162_1338, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:43,086 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742160_1336, blk_1073742161_1337, blk_1073742162_1338, blk_1073742164_1340, blk_1073742158_1334, blk_1073742159_1335]
2015-03-13 10:12:43,086 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:43,086 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:43,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000005 by user soberoi
2015-03-13 10:12:43,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0029
2015-03-13 10:12:43,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000006 by user soberoi
2015-03-13 10:12:43,089 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:43,089 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:43,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000004 by user soberoi
2015-03-13 10:12:43,090 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000003 by user soberoi
2015-03-13 10:12:43,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:43,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:43,089 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0029_01_000002 by user soberoi
2015-03-13 10:12:43,090 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000006 to application application_1426266260362_0029
2015-03-13 10:12:43,090 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:43,090 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,090 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,090 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,090 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,091 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,090 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from NEW to INITING
2015-03-13 10:12:43,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000005 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000004 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000003 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0029_01_000002 to application application_1426266260362_0029
2015-03-13 10:12:43,091 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from INITING to RUNNING
2015-03-13 10:12:43,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:43,092 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,092 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,092 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,092 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,092 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:43,093 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,093 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,093 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,093 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,094 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0029
2015-03-13 10:12:43,094 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:43,094 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0029
2015-03-13 10:12:43,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000002
2015-03-13 10:12:43,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000003
2015-03-13 10:12:43,096 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000004
2015-03-13 10:12:43,097 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0029_01_000005
2015-03-13 10:12:43,118 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0029_01_000002.tokens. Credentials list:
2015-03-13 10:12:43,119 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0029_01_000003.tokens. Credentials list:
2015-03-13 10:12:43,119 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0029_01_000004.tokens. Credentials list:
2015-03-13 10:12:43,119 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0029_01_000005.tokens. Credentials list:
2015-03-13 10:12:43,133 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,133 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,136 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:43,201 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006/default_container_executor.sh]
2015-03-13 10:12:43,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0029_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002.tokens
2015-03-13 10:12:43,210 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:43,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:43,282 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:43,283 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar dst=null perm=null
2015-03-13 10:12:43,290 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63327, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-901806963_15552, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348, duration: 451000
2015-03-13 10:12:43,309 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:43,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:43,327 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:43,328 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml dst=null perm=null
2015-03-13 10:12:43,335 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63328, bytes: 98556, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-901806963_15552, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742175_1351, duration: 274000
2015-03-13 10:12:43,352 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:43,352 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,352 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:43,377 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,379 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:43,379 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0028
2015-03-13 10:12:43,380 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:43,380 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0028, with delay of 10800 seconds
2015-03-13 10:12:43,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,380 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,381 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,381 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,415 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,415 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,415 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,415 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,422 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,422 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,430 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:43,430 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:43,548 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002/default_container_executor.sh]
2015-03-13 10:12:43,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004/default_container_executor.sh]
2015-03-13 10:12:43,557 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005/default_container_executor.sh]
2015-03-13 10:12:43,574 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003/default_container_executor.sh]
2015-03-13 10:12:43,799 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:43,800 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:43,839 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:43,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0028
2015-03-13 10:12:43,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,839 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0028 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:43,839 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0028, with delay of 10800 seconds
2015-03-13 10:12:43,839 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0028
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:43,867 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:43,979 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:12:44,051 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742161_1337 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742161
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742160_1336 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742160
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159 for deletion
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742162_1338 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742162
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742159_1335 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742159
2015-03-13 10:12:44,052 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742164_1340 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742164
2015-03-13 10:12:44,053 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742158_1334 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742158
2015-03-13 10:12:44,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,381 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,384 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,499 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/nmPrivate/container_1426266260362_0029_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005.tokens
2015-03-13 10:12:44,499 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:44,598 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,731 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0029_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004.tokens
2015-03-13 10:12:44,731 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:44,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,800 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:44,827 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:44,959 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/nmPrivate/container_1426266260362_0029_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003.tokens
2015-03-13 10:12:44,959 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:45,026 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:45,231 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742172_1348
2015-03-13 10:12:45,384 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,385 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:45,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,186 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352
2015-03-13 10:12:46,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,389 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,811 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:46,811 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,816 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:47,816 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,391 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,392 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,392 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,817 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:48,818 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,392 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,393 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,818 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:49,818 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,394 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,395 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,819 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:50,819 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:51,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,397 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,418 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63338, bytes: 721, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 181000
2015-03-13 10:12:51,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:51,613 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:51,640 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004 dst=null perm=null
2015-03-13 10:12:51,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:51,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00004 dst=null perm=null
2015-03-13 10:12:51,656 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63342, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742163_1339, duration: 133000
2015-03-13 10:12:51,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:51,734 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63343, bytes: 1753, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 151000
2015-03-13 10:12:51,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job.split dst=null perm=null
2015-03-13 10:12:51,799 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63345, bytes: 1237, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 179000
2015-03-13 10:12:51,823 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,823 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:51,842 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63346, bytes: 1753, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 144000
2015-03-13 10:12:51,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000 dst=null perm=null
2015-03-13 10:12:51,890 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00000 dst=null perm=null
2015-03-13 10:12:51,892 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63348, bytes: 118, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742165_1341, duration: 150000
2015-03-13 10:12:51,898 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63347, bytes: 721, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742173_1349, duration: 141000
2015-03-13 10:12:51,940 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002 dst=null perm=null
2015-03-13 10:12:51,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00002 dst=null perm=null
2015-03-13 10:12:51,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:51,955 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63349, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742166_1342, duration: 145000
2015-03-13 10:12:51,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001 dst=null perm=null
2015-03-13 10:12:51,969 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00001 dst=null perm=null
2015-03-13 10:12:51,972 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63350, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742167_1343, duration: 154000
2015-03-13 10:12:52,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,016 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003 dst=null perm=null
2015-03-13 10:12:52,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5/part-00003 dst=null perm=null
2015-03-13 10:12:52,035 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63351, bytes: 96, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742168_1344, duration: 157000
2015-03-13 10:12:52,100 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,138 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,143 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,148 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63338, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 137000
2015-03-13 10:12:52,181 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004. BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,224 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63352 dest: /127.0.0.1:60696
2015-03-13 10:12:52,225 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63353 dest: /127.0.0.1:60689
2015-03-13 10:12:52,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353 src: /127.0.0.1:63354 dest: /127.0.0.1:60693
2015-03-13 10:12:52,237 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63354, dest: /127.0.0.1:60693, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 8590000
2015-03-13 10:12:52,237 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,237 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,237 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63353, dest: /127.0.0.1:60689, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 9247000
2015-03-13 10:12:52,238 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,238 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,238 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63352, dest: /127.0.0.1:60696, bytes: 70, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 10062000
2015-03-13 10:12:52,238 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,239 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742177_1353{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,245 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0029_m_000004_0_-756137194_1
2015-03-13 10:12:52,254 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0 dst=null perm=null
2015-03-13 10:12:52,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0 dst=null perm=null
2015-03-13 10:12:52,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004 dst=null perm=null
2015-03-13 10:12:52,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000004_0 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,284 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000006
2015-03-13 10:12:52,284 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:52,284 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,285 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000006
2015-03-13 10:12:52,285 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,285 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,297 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000006 is : 143
2015-03-13 10:12:52,298 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:52,300 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63355 dest: /127.0.0.1:60696
2015-03-13 10:12:52,301 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63356 dest: /127.0.0.1:60693
2015-03-13 10:12:52,302 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354 src: /127.0.0.1:63357 dest: /127.0.0.1:60686
2015-03-13 10:12:52,306 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist for DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,309 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,310 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000006 from application application_1426266260362_0029
2015-03-13 10:12:52,310 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,310 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,310 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000006
2015-03-13 10:12:52,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,401 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,402 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,497 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63358, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 178000
2015-03-13 10:12:52,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,538 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:12:52,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,552 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63360, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 155000
2015-03-13 10:12:52,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,569 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,574 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63361, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 148000
2015-03-13 10:12:52,580 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63359 dest: /127.0.0.1:60696
2015-03-13 10:12:52,581 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63362 dest: /127.0.0.1:60689
2015-03-13 10:12:52,583 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355 src: /127.0.0.1:63363 dest: /127.0.0.1:60686
2015-03-13 10:12:52,590 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63363, dest: /127.0.0.1:60686, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 6077000
2015-03-13 10:12:52,590 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,591 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63362, dest: /127.0.0.1:60689, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 6759000
2015-03-13 10:12:52,591 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,591 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,592 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63359, dest: /127.0.0.1:60696, bytes: 138, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 7839000
2015-03-13 10:12:52,592 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,592 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,593 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742179_1355{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,597 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,601 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0029_m_000000_0_-148738810_1
2015-03-13 10:12:52,606 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:52,611 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0 dst=null perm=null
2015-03-13 10:12:52,627 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0 dst=null perm=null
2015-03-13 10:12:52,628 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000 dst=null perm=null
2015-03-13 10:12:52,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000000_0 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,646 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,646 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000002
2015-03-13 10:12:52,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,646 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,647 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,659 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000002 is : 143
2015-03-13 10:12:52,669 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63364 dest: /127.0.0.1:60686
2015-03-13 10:12:52,670 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63366 dest: /127.0.0.1:60696
2015-03-13 10:12:52,670 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,671 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356 src: /127.0.0.1:63367 dest: /127.0.0.1:60693
2015-03-13 10:12:52,672 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000002
2015-03-13 10:12:52,673 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,673 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,673 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000002 from application application_1426266260362_0029
2015-03-13 10:12:52,673 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,673 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,677 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63365 dest: /127.0.0.1:60696
2015-03-13 10:12:52,678 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63368 dest: /127.0.0.1:60686
2015-03-13 10:12:52,680 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357 src: /127.0.0.1:63369 dest: /127.0.0.1:60689
2015-03-13 10:12:52,682 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63367, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 9089000
2015-03-13 10:12:52,682 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,683 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,683 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63366, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 9714000
2015-03-13 10:12:52,683 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,683 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,684 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63364, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 10527000
2015-03-13 10:12:52,684 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,684 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742180_1356{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,688 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0029_m_000002_0_1493284587_1
2015-03-13 10:12:52,693 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63369, dest: /127.0.0.1:60689, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 12479000
2015-03-13 10:12:52,694 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,694 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,694 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63368, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 13086000
2015-03-13 10:12:52,694 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,695 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,695 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63365, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 13749000
2015-03-13 10:12:52,695 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,695 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742181_1357{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:52,701 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0029_m_000001_0_1501290920_1
2015-03-13 10:12:52,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0 dst=null perm=null
2015-03-13 10:12:52,712 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0 dst=null perm=null
2015-03-13 10:12:52,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002 dst=null perm=null
2015-03-13 10:12:52,717 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000002_0 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,730 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000004
2015-03-13 10:12:52,730 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,730 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,730 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,730 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000004
2015-03-13 10:12:52,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000002
2015-03-13 10:12:52,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,731 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,732 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,732 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,732 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000002
2015-03-13 10:12:52,732 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:12:52,732 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:12:52,732 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000002, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,732 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,732 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:12:52,732 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000002 on node: host: 10.1.1.144:60719 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:12:52,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,744 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000004 is : 143
2015-03-13 10:12:52,752 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,755 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,756 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,756 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000004
2015-03-13 10:12:52,757 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,757 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,757 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000004 from application application_1426266260362_0029
2015-03-13 10:12:52,757 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,758 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,759 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:12:52,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0 dst=null perm=null
2015-03-13 10:12:52,769 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63370, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 143000
2015-03-13 10:12:52,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0 dst=null perm=null
2015-03-13 10:12:52,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001 dst=null perm=null
2015-03-13 10:12:52,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000001_0 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,784 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,784 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000003
2015-03-13 10:12:52,784 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,785 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,785 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000004
2015-03-13 10:12:52,785 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:52,785 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,785 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,785 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000004
2015-03-13 10:12:52,785 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:12:52,786 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:12:52,786 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000004, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,786 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,786 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:12:52,786 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000004 on node: host: 10.1.1.144:60719 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:52,797 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000003 is : 143
2015-03-13 10:12:52,809 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,809 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,810 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000003
2015-03-13 10:12:52,811 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,811 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,811 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000003 from application application_1426266260362_0029
2015-03-13 10:12:52,811 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,811 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,820 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:52,862 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63371 dest: /127.0.0.1:60696
2015-03-13 10:12:52,864 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63372 dest: /127.0.0.1:60686
2015-03-13 10:12:52,865 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358 src: /127.0.0.1:63373 dest: /127.0.0.1:60693
2015-03-13 10:12:52,873 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63373, dest: /127.0.0.1:60693, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 6515000
2015-03-13 10:12:52,874 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,874 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63372, dest: /127.0.0.1:60686, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 7508000
2015-03-13 10:12:52,875 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,875 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63371, dest: /127.0.0.1:60696, bytes: 104, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 8440000
2015-03-13 10:12:52,875 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,875 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,876 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742182_1358{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:52,881 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0029_m_000003_0_-963552514_1
2015-03-13 10:12:52,889 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0 dst=null perm=null
2015-03-13 10:12:52,894 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0 dst=null perm=null
2015-03-13 10:12:52,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003 dst=null perm=null
2015-03-13 10:12:52,897 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/_temporary/attempt_1426266260362_0029_m_000003_0 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:52,905 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:12:52,905 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:52,905 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000005
2015-03-13 10:12:52,905 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000003
2015-03-13 10:12:52,906 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:12:52,906 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:52,906 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:12:52,906 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000003
2015-03-13 10:12:52,906 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:12:52,906 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:12:52,906 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000003, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,906 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:52,906 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:12:52,907 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000003 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:12:52,909 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,912 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,916 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1 dst=null perm=null
2015-03-13 10:12:52,919 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0029_01_000005 is : 143
2015-03-13 10:12:52,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,924 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000 dst=null perm=null
2015-03-13 10:12:52,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:12:52,929 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000000/part-00000 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,931 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:12:52,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000005
2015-03-13 10:12:52,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:52,933 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,933 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:12:52,933 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000005 from application application_1426266260362_0029
2015-03-13 10:12:52,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,934 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:52,934 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:52,934 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001 dst=null perm=null
2015-03-13 10:12:52,936 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:12:52,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000001/part-00001 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,938 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,939 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002 dst=null perm=null
2015-03-13 10:12:52,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:12:52,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000002/part-00002 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,945 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,946 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,947 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003 dst=null perm=null
2015-03-13 10:12:52,948 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:12:52,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000003/part-00003 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:12:52,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004 dst=null perm=null
2015-03-13 10:12:52,952 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:12:52,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary/1/task_1426266260362_0029_m_000004/part-00004 dst=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,955 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_temporary dst=null perm=null
2015-03-13 10:12:52,959 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,961 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/_SUCCESS is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,966 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,979 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63357, dest: /127.0.0.1:60686, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 675400000
2015-03-13 10:12:52,979 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,980 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,980 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63356, dest: /127.0.0.1:60693, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 676635000
2015-03-13 10:12:52,981 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,982 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,982 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63355, dest: /127.0.0.1:60696, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 678116000
2015-03-13 10:12:52,982 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,982 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742178_1354{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:12:52,984 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:52,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:52,988 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:52,989 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63374 dest: /127.0.0.1:60686
2015-03-13 10:12:52,990 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63375 dest: /127.0.0.1:60693
2015-03-13 10:12:52,992 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359 src: /127.0.0.1:63376 dest: /127.0.0.1:60696
2015-03-13 10:12:52,994 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63376, dest: /127.0.0.1:60696, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 1165000
2015-03-13 10:12:52,994 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:52,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,995 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63375, dest: /127.0.0.1:60693, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 1666000
2015-03-13 10:12:52,995 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,995 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,995 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63374, dest: /127.0.0.1:60686, bytes: 419, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 2426000
2015-03-13 10:12:52,996 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:52,996 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742183_1359{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:52,997 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,001 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist dst=null perm=null
2015-03-13 10:12:53,006 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:53,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist dst=null perm=null
2015-03-13 10:12:53,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:12:53,011 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1.jhist dst=null perm=null
2015-03-13 10:12:53,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:53,016 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63377, bytes: 53656, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354, duration: 176000
2015-03-13 10:12:53,018 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:53,020 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63378 dest: /127.0.0.1:60686
2015-03-13 10:12:53,021 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63379 dest: /127.0.0.1:60689
2015-03-13 10:12:53,023 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360 src: /127.0.0.1:63380 dest: /127.0.0.1:60696
2015-03-13 10:12:53,026 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63380, dest: /127.0.0.1:60696, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 1799000
2015-03-13 10:12:53,026 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:53,026 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,027 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63379, dest: /127.0.0.1:60689, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 2426000
2015-03-13 10:12:53,027 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,027 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,027 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63378, dest: /127.0.0.1:60686, bytes: 53240, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, duration: 3141000
2015-03-13 10:12:53,027 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,028 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742184_1360{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:53,029 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,031 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,032 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml dst=null perm=null
2015-03-13 10:12:53,033 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:53,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml dst=null perm=null
2015-03-13 10:12:53,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp dst=null perm=null
2015-03-13 10:12:53,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029/job_1426266260362_0029_1_conf.xml dst=null perm=null
2015-03-13 10:12:53,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:53,039 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63377, bytes: 91453, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742176_1352, duration: 215000
2015-03-13 10:12:53,040 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:12:53,042 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63381 dest: /127.0.0.1:60693
2015-03-13 10:12:53,043 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63382 dest: /127.0.0.1:60696
2015-03-13 10:12:53,044 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361 src: /127.0.0.1:63383 dest: /127.0.0.1:60689
2015-03-13 10:12:53,047 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63383, dest: /127.0.0.1:60689, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 1506000
2015-03-13 10:12:53,047 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:53,047 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,047 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63382, dest: /127.0.0.1:60696, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 1988000
2015-03-13 10:12:53,047 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,048 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,048 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63381, dest: /127.0.0.1:60693, bytes: 90741, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_2012353289_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, duration: 2660000
2015-03-13 10:12:53,048 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:53,049 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742185_1361{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:12:53,050 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_2012353289_1
2015-03-13 10:12:53,052 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,054 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:12:53,064 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from RUNNING to FINISHING
2015-03-13 10:12:53,064 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0029
2015-03-13 10:12:53,064 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from RUNNING to REMOVING
2015-03-13 10:12:53,064 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0029
2015-03-13 10:12:53,064 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from REMOVING to FINISHING
2015-03-13 10:12:53,288 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:53,288 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:53,288 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000006
2015-03-13 10:12:53,288 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:53,288 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:12:53,288 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000006
2015-03-13 10:12:53,288 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:53,289 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:12:53,289 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,289 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,289 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:12:53,289 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000006 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:53,911 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:12:53,911 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000005
2015-03-13 10:12:53,912 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:53,912 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:12:53,912 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000005
2015-03-13 10:12:53,912 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:12:53,913 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:12:53,913 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000005, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,913 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:53,913 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:12:53,913 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000005 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:12:54,069 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742172_1348 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:12:54,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742173_1349 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:12:54,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742174_1350 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:12:54,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742175_1351 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:12:54,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742178_1354 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:12:54,070 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742176_1352 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:12:54,070 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0029 dst=null perm=null
2015-03-13 10:12:54,105 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] starting step: (1/3) ...rm/joinsamesourceintojoin
2015-03-13 10:12:54,112 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,120 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,122 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:12:54,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:54,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:54,125 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 30
2015-03-13 10:12:54,126 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=null
2015-03-13 10:12:54,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:12:54,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:12:54,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,131 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,132 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63386 dest: /127.0.0.1:60696
2015-03-13 10:12:54,133 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63387 dest: /127.0.0.1:60686
2015-03-13 10:12:54,134 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63388 dest: /127.0.0.1:60693
2015-03-13 10:12:54,138 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63388, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 1796000
2015-03-13 10:12:54,138 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,138 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,138 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63387, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 2146000
2015-03-13 10:12:54,139 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,139 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,139 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63386, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 3167000
2015-03-13 10:12:54,139 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,143 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742186_1362{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,143 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,144 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar
2015-03-13 10:12:54,144 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:54,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:54,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:54,147 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:12:54,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:12:54,148 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:12:54,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:12:54,149 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:12:54,150 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:54,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:54,151 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:12:54,151 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:12:54,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,155 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split
2015-03-13 10:12:54,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,156 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:54,157 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63389 dest: /127.0.0.1:60686
2015-03-13 10:12:54,158 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63390 dest: /127.0.0.1:60689
2015-03-13 10:12:54,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63391 dest: /127.0.0.1:60693
2015-03-13 10:12:54,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363 src: /127.0.0.1:63392 dest: /127.0.0.1:60696
2015-03-13 10:12:54,163 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63392, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 1570000
2015-03-13 10:12:54,163 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63391, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 1799000
2015-03-13 10:12:54,164 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63390, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 2611000
2015-03-13 10:12:54,165 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,165 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63389, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 3518000
2015-03-13 10:12:54,166 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,166 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742187_1363{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:54,167 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,168 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,171 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,172 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63393 dest: /127.0.0.1:60686
2015-03-13 10:12:54,173 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63394 dest: /127.0.0.1:60689
2015-03-13 10:12:54,175 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364 src: /127.0.0.1:63395 dest: /127.0.0.1:60693
2015-03-13 10:12:54,177 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63395, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 1143000
2015-03-13 10:12:54,177 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,178 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,178 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63394, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 1541000
2015-03-13 10:12:54,178 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,178 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,179 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63393, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 2306000
2015-03-13 10:12:54,179 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,179 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742188_1364{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,181 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,181 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:12:54,182 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,184 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:12:54,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:12:54,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:12:54,185 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:12:54,195 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:12:54,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63396 dest: /127.0.0.1:60686
2015-03-13 10:12:54,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63397 dest: /127.0.0.1:60689
2015-03-13 10:12:54,198 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365 src: /127.0.0.1:63398 dest: /127.0.0.1:60693
2015-03-13 10:12:54,201 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63398, dest: /127.0.0.1:60693, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 1536000
2015-03-13 10:12:54,201 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:54,201 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,202 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63397, dest: /127.0.0.1:60689, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 1941000
2015-03-13 10:12:54,202 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,202 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63396, dest: /127.0.0.1:60686, bytes: 98220, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 2592000
2015-03-13 10:12:54,202 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:54,203 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742189_1365{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:12:54,204 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:12:54,204 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0030
2015-03-13 10:12:54,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=null
2015-03-13 10:12:54,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:54,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:54,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:54,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:54,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:54,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:54,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:54,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:54,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:54,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:54,213 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 30 submitted by user soberoi
2015-03-13 10:12:54,213 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0030
2015-03-13 10:12:54,213 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from NEW to NEW_SAVING
2015-03-13 10:12:54,214 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0030
2015-03-13 10:12:54,213 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0030
2015-03-13 10:12:54,214 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:12:54,214 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,214 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from NEW to SUBMITTED
2015-03-13 10:12:54,214 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0030 from user: soberoi activated in queue: default
2015-03-13 10:12:54,214 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0030 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:12:54,214 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0030 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:12:54,214 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0030 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:12:54,215 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0030_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:12:54,215 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:12:54,216 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from SUBMITTED to ACCEPTED
2015-03-13 10:12:54,217 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0030/
2015-03-13 10:12:54,217 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] submitted hadoop job: job_1426266260362_0030
2015-03-13 10:12:54,217 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper1*upper2] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0030/
2015-03-13 10:12:54,290 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:54,291 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:54,291 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:12:54,291 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:12:54,291 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0030_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:54,292 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:12:54,292 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:54,292 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:54,293 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0030 AttemptId: appattempt_1426266260362_0030_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ]
2015-03-13 10:12:54,293 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:12:54,293 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,293 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:12:54,293 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0030_000001
2015-03-13 10:12:54,293 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,294 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0030_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:12:54,296 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:54,297 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000001 by user soberoi
2015-03-13 10:12:54,297 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:54,297 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:12:54,297 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:54,297 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000001 to application application_1426266260362_0030
2015-03-13 10:12:54,297 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:54,297 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] for AM appattempt_1426266260362_0030_000001
2015-03-13 10:12:54,298 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:12:54,298 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:12:54,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:54,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:54,298 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000001
2015-03-13 10:12:54,310 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0030_01_000001.tokens. Credentials list:
2015-03-13 10:12:54,325 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:54,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0030_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001.tokens
2015-03-13 10:12:54,400 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:54,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:54,478 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63402, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 362000
2015-03-13 10:12:54,499 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:54,516 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:54,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:54,523 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 167000
2015-03-13 10:12:54,536 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,552 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:12:54,559 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 180000
2015-03-13 10:12:54,572 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:54,589 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:54,590 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:54,596 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63403, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-147625035_15914, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 368000
2015-03-13 10:12:54,608 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:54,608 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:12:54,634 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:12:54,634 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:54,705 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001/default_container_executor.sh]
2015-03-13 10:12:55,098 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60693 to replicate blk_1073742186_1362 to datanode(s) 127.0.0.1:60689
2015-03-13 10:12:55,098 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742176_1352, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350]
2015-03-13 10:12:55,098 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742176_1352, blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350, blk_1073742175_1351]
2015-03-13 10:12:55,239 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:55,240 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:55,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:55,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:55,241 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:55,242 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:55,242 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:55,242 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:55,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:55,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:55,294 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:55,658 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:55,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:55,878 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1589780806-10.1.1.144-60693-1426266259390, infoPort=60694, ipcPort=60695, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 to 127.0.0.1:60689
2015-03-13 10:12:55,878 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:55,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:55,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:55,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:55,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:55,879 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:55,880 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:12:55,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:55,881 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:55,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:55,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:55,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:55,882 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:55,883 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63404 dest: /127.0.0.1:60689
2015-03-13 10:12:55,885 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362 src: /127.0.0.1:63404 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:12:55,886 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742186_1362 size 254067
2015-03-13 10:12:56,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354
2015-03-13 10:12:56,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,195 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:56,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:56,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:56,196 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,197 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:56,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:56,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:56,250 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,252 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:56,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:56,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:56,354 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:12:56,375 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED dst=null perm=null
2015-03-13 10:12:56,376 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:12:56,377 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_FAIL dst=null perm=null
2015-03-13 10:12:56,397 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:56,398 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:56,399 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:56,399 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:56,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=null
2015-03-13 10:12:56,437 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:12:56,438 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:12:56,453 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:56,454 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,454 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:56,455 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365
2015-03-13 10:12:56,455 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364
2015-03-13 10:12:56,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:56,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.splitmetainfo dst=null perm=null
2015-03-13 10:12:56,795 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63406, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742188_1364, duration: 123000
2015-03-13 10:12:56,796 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353
2015-03-13 10:12:56,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355
2015-03-13 10:12:56,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357
2015-03-13 10:12:56,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359
2015-03-13 10:12:56,797 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358
2015-03-13 10:12:56,798 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742178_1354
2015-03-13 10:12:57,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:12:57,000 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363
2015-03-13 10:12:57,001 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356
2015-03-13 10:12:57,001 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742184_1360
2015-03-13 10:12:57,002 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742185_1361
2015-03-13 10:12:57,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:57,300 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:57,590 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:57,592 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0030_000001
2015-03-13 10:12:57,592 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0030 APPATTEMPTID=appattempt_1426266260362_0030_000001
2015-03-13 10:12:57,592 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:12:57,592 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from ACCEPTED to RUNNING
2015-03-13 10:12:57,614 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:57,615 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:12:57,700 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:12:57,817 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:12:57,857 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63412 dest: /127.0.0.1:60689
2015-03-13 10:12:57,858 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63413 dest: /127.0.0.1:60686
2015-03-13 10:12:57,860 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366 src: /127.0.0.1:63414 dest: /127.0.0.1:60696
2015-03-13 10:12:57,871 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63414, dest: /127.0.0.1:60696, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 5870000
2015-03-13 10:12:57,871 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:12:57,871 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,871 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63413, dest: /127.0.0.1:60686, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 10147000
2015-03-13 10:12:57,872 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:57,872 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,872 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63412, dest: /127.0.0.1:60689, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 11052000
2015-03-13 10:12:57,872 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:12:57,873 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742190_1366{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:12:57,877 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:12:58,103 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742175_1351]
2015-03-13 10:12:58,103 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742176_1352, blk_1073742178_1354, blk_1073742172_1348, blk_1073742173_1349, blk_1073742174_1350, blk_1073742175_1351]
2015-03-13 10:12:58,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:58,304 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176 for deletion
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742176_1352 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742176
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:58,659 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174 for deletion
2015-03-13 10:12:58,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:58,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:58,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:58,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742174_1350 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742174
2015-03-13 10:12:58,660 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:58,873 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,873 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:12:58,873 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:58,873 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,874 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:12:58,874 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,874 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:12:58,875 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:12:58,875 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,875 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:12:58,875 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,876 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,876 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:12:58,876 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:12:58,876 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,876 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:12:58,877 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,877 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,877 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:12:58,877 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:12:58,877 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0030_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,877 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:12:58,877 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,878 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:12:58,878 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:12:58,878 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:12:58,878 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0030 container=Container: [ContainerId: container_1426266260362_0030_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0030_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:58,878 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:12:58,878 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,065 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178 for deletion
2015-03-13 10:12:59,065 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172 for deletion
2015-03-13 10:12:59,065 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173 for deletion
2015-03-13 10:12:59,065 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742178_1354 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742178
2015-03-13 10:12:59,065 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175 for deletion
2015-03-13 10:12:59,066 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742173_1349 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742173
2015-03-13 10:12:59,066 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742172_1348 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742172
2015-03-13 10:12:59,066 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742175_1351 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742175
2015-03-13 10:12:59,098 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0029_01_000001 succeeded
2015-03-13 10:12:59,098 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:12:59,098 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,105 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029/container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:59,106 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0029_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:12:59,106 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0029_01_000001 from application application_1426266260362_0029
2015-03-13 10:12:59,106 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:12:59,106 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0029
2015-03-13 10:12:59,308 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 29 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:12:59,308 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0029_01_000001
2015-03-13 10:12:59,308 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,309 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0029_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:12:59,309 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0029_000001
2015-03-13 10:12:59,309 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0029_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:12:59,309 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0029 CONTAINERID=container_1426266260362_0029_01_000001
2015-03-13 10:12:59,309 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0029_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:12:59,309 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0029_000001 State change from FINISHING to FINISHED
2015-03-13 10:12:59,309 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:12:59,310 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0029 State change from FINISHING to FINISHED
2015-03-13 10:12:59,310 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0029_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,310 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0029
2015-03-13 10:12:59,310 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0029_000001
2015-03-13 10:12:59,310 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:12:59,310 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0029,name=[B61955F7F1A34D09B0265BE65DDD3B28/8EF7DC42A1E14629BD263FCEE1EED9A7] lower*upper1*upper2/(2/3),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0029/jobhistory/job/job_1426266260362_0029,appMasterHost=Edinburgh.local,startTime=1426266757667,finishTime=1426266773064,finalStatus=SUCCEEDED
2015-03-13 10:12:59,310 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:12:59,311 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0029_000001 released container container_1426266260362_0029_01_000001 on node: host: 10.1.1.144:60715 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:12:59,311 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0029_000001 is done. finalState=FINISHED
2015-03-13 10:12:59,311 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0029 requests cleared
2015-03-13 10:12:59,311 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0029 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:12:59,311 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0029 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:12:59,313 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0029_000001 (auth:SIMPLE)
2015-03-13 10:12:59,314 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0029_01_000001
2015-03-13 10:12:59,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,626 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:12:59,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,662 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,663 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:59,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:59,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:59,673 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:59,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:12:59,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:12:59,730 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:59,730 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:12:59,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000005 by user soberoi
2015-03-13 10:12:59,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:59,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000006 by user soberoi
2015-03-13 10:12:59,733 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:12:59,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000003 by user soberoi
2015-03-13 10:12:59,734 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:12:59,734 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:59,734 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000005 to application application_1426266260362_0030
2015-03-13 10:12:59,734 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000003 to application application_1426266260362_0030
2015-03-13 10:12:59,734 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:59,734 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000004 by user soberoi
2015-03-13 10:12:59,734 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,734 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:12:59,734 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,735 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,735 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0030_01_000002 by user soberoi
2015-03-13 10:12:59,733 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0030
2015-03-13 10:12:59,735 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:12:59,735 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:12:59,735 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,735 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,735 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,735 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,735 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,736 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000004 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,736 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,736 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,736 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,736 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000002 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000005
2015-03-13 10:12:59,736 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from NEW to INITING
2015-03-13 10:12:59,736 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0030_01_000006 to application application_1426266260362_0030
2015-03-13 10:12:59,736 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from INITING to RUNNING
2015-03-13 10:12:59,737 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,737 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,737 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,737 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,737 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,737 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,737 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:12:59,737 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000006
2015-03-13 10:12:59,737 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,738 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000003
2015-03-13 10:12:59,739 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:12:59,739 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,740 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,740 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0030
2015-03-13 10:12:59,740 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:12:59,740 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0030
2015-03-13 10:12:59,740 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000004
2015-03-13 10:12:59,741 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0030_01_000002
2015-03-13 10:12:59,760 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0030_01_000006.tokens. Credentials list:
2015-03-13 10:12:59,761 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000003.tokens. Credentials list:
2015-03-13 10:12:59,762 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000004.tokens. Credentials list:
2015-03-13 10:12:59,762 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000005.tokens. Credentials list:
2015-03-13 10:12:59,763 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0030_01_000002.tokens. Credentials list:
2015-03-13 10:12:59,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:59,786 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:12:59,861 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003.tokens
2015-03-13 10:12:59,861 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0030_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006.tokens
2015-03-13 10:12:59,861 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:59,861 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:12:59,873 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,873 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,873 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,874 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,874 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,876 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:12:59,876 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:12:59,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,928 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,928 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:12:59,928 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,928 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0029
2015-03-13 10:12:59,928 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:12:59,929 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0029, with delay of 10800 seconds
2015-03-13 10:12:59,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:12:59,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,931 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar dst=null perm=null
2015-03-13 10:12:59,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63423, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2122296876_16061, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 509000
2015-03-13 10:12:59,938 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63422, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1515957640_16062, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362, duration: 563000
2015-03-13 10:12:59,959 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:59,959 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:12:59,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,978 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,980 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml dst=null perm=null
2015-03-13 10:12:59,986 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63422, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2122296876_16061, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 277000
2015-03-13 10:12:59,987 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63424, bytes: 98988, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1515957640_16062, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742189_1365, duration: 249000
2015-03-13 10:13:00,004 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:00,004 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,005 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:00,005 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:00,061 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,061 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,061 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,061 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,071 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:00,071 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:00,204 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002/default_container_executor.sh]
2015-03-13 10:13:00,213 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005/default_container_executor.sh]
2015-03-13 10:13:00,224 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004/default_container_executor.sh]
2015-03-13 10:13:00,225 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003/default_container_executor.sh]
2015-03-13 10:13:00,233 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006/default_container_executor.sh]
2015-03-13 10:13:00,248 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:00,311 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,312 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:00,312 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,312 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0029
2015-03-13 10:13:00,312 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,312 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0029 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:00,312 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0029, with delay of 10800 seconds
2015-03-13 10:13:00,312 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,313 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0029
2015-03-13 10:13:00,452 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742186_1362
2015-03-13 10:13:00,643 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:13:00,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:00,879 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,036 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0030_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002.tokens
2015-03-13 10:13:01,151 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,255 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,313 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,371 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005.tokens
2015-03-13 10:13:01,371 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,403 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:01,463 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:01,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0030_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004.tokens
2015-03-13 10:13:01,589 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:01,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:01,881 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,010 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366
2015-03-13 10:13:02,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:02,886 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,315 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,889 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:03,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,317 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,890 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:04,891 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,320 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,894 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:05,895 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,321 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:06,896 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,324 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,897 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,901 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,902 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:07,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:13:08,172 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:13:08,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:13:08,195 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:13:08,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job.split dst=null perm=null
2015-03-13 10:13:08,254 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63437, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 160000
2015-03-13 10:13:08,325 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,360 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63439, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 157000
2015-03-13 10:13:08,373 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 148000
2015-03-13 10:13:08,378 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63440, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 1024, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 145000
2015-03-13 10:13:08,406 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:08,410 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63443, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:13:08,415 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742187_1363, duration: 150000
2015-03-13 10:13:08,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:08,495 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:08,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63444, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 154000
2015-03-13 10:13:08,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,515 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:08,521 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63445, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 146000
2015-03-13 10:13:08,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,538 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:08,542 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63446, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 133000
2015-03-13 10:13:08,559 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:08,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,895 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:08,896 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:08,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63447, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 153000
2015-03-13 10:13:08,899 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,907 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,908 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:08,914 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:08,915 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:08,917 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63447, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 156000
2015-03-13 10:13:08,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:08,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:08,923 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 160000
2015-03-13 10:13:08,925 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:08,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:08,928 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 144000
2015-03-13 10:13:08,930 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:08,932 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:08,934 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63448, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 159000
2015-03-13 10:13:08,935 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,941 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,954 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,962 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002. BP-1005356445-10.1.1.144-1426266257849 blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:08,979 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,988 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:08,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:09,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63449 dest: /127.0.0.1:60693
2015-03-13 10:13:09,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63450 dest: /127.0.0.1:60689
2015-03-13 10:13:09,005 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,006 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367 src: /127.0.0.1:63451 dest: /127.0.0.1:60686
2015-03-13 10:13:09,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,013 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63439, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 150000
2015-03-13 10:13:09,014 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63451, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 7031000
2015-03-13 10:13:09,015 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,015 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,015 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63450, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 7613000
2015-03-13 10:13:09,015 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,016 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,016 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63449, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 8393000
2015-03-13 10:13:09,016 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,016 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742191_1367{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,020 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0030_m_000002_0_-1467547046_1
2015-03-13 10:13:09,028 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0 dst=null perm=null
2015-03-13 10:13:09,034 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0 dst=null perm=null
2015-03-13 10:13:09,035 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002 dst=null perm=null
2015-03-13 10:13:09,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,038 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,040 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,041 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63452, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 153000
2015-03-13 10:13:09,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,043 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 148000
2015-03-13 10:13:09,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,047 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63454, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 157000
2015-03-13 10:13:09,049 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,051 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,054 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63455, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 159000
2015-03-13 10:13:09,056 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,058 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,060 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,060 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000004
2015-03-13 10:13:09,060 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63452, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 147000
2015-03-13 10:13:09,060 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,060 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,061 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,063 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,065 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 167000
2015-03-13 10:13:09,072 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000004 is : 143
2015-03-13 10:13:09,075 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:09,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63456 dest: /127.0.0.1:60693
2015-03-13 10:13:09,078 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63457 dest: /127.0.0.1:60696
2015-03-13 10:13:09,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368 src: /127.0.0.1:63458 dest: /127.0.0.1:60689
2015-03-13 10:13:09,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,084 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist for DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,085 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,085 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,085 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000004 from application application_1426266260362_0030
2015-03-13 10:13:09,085 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,085 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,086 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000004
2015-03-13 10:13:09,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:09,096 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0030_m_000004_0_-686168108_1
2015-03-13 10:13:09,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,100 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63459, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 190000
2015-03-13 10:13:09,101 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:09,104 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,107 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63459, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 151000
2015-03-13 10:13:09,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0 dst=null perm=null
2015-03-13 10:13:09,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,116 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63453, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 152000
2015-03-13 10:13:09,118 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:09,119 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0 dst=null perm=null
2015-03-13 10:13:09,120 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004 dst=null perm=null
2015-03-13 10:13:09,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,129 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,130 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,133 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 155000
2015-03-13 10:13:09,134 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,135 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000006
2015-03-13 10:13:09,135 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,147 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000006 is : 143
2015-03-13 10:13:09,153 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,155 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,158 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63461, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 145000
2015-03-13 10:13:09,159 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,159 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,160 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:09,161 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,161 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000006 from application application_1426266260362_0030
2015-03-13 10:13:09,161 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,162 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,168 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:09,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,173 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,175 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 150000
2015-03-13 10:13:09,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,177 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00000 dst=null perm=null
2015-03-13 10:13:09,179 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 142, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742179_1355, duration: 148000
2015-03-13 10:13:09,183 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,188 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,191 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63460, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 155000
2015-03-13 10:13:09,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,194 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,195 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 152000
2015-03-13 10:13:09,199 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63441, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 144000
2015-03-13 10:13:09,204 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00001 dst=null perm=null
2015-03-13 10:13:09,207 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742181_1357, duration: 149000
2015-03-13 10:13:09,211 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,213 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00002 dst=null perm=null
2015-03-13 10:13:09,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63462 dest: /127.0.0.1:60689
2015-03-13 10:13:09,215 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742180_1356, duration: 164000
2015-03-13 10:13:09,216 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63463 dest: /127.0.0.1:60686
2015-03-13 10:13:09,218 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369 src: /127.0.0.1:63464 dest: /127.0.0.1:60693
2015-03-13 10:13:09,228 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,228 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,229 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63464, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 9680000
2015-03-13 10:13:09,229 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,230 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,240 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63463, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 9806000
2015-03-13 10:13:09,240 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,241 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63462, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 20873000
2015-03-13 10:13:09,241 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00003 dst=null perm=null
2015-03-13 10:13:09,243 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,243 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742193_1369{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,250 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0030_m_000003_0_-1108770989_1
2015-03-13 10:13:09,253 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 108, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742182_1358, duration: 145000
2015-03-13 10:13:09,256 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5/part-00004 dst=null perm=null
2015-03-13 10:13:09,260 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63442, bytes: 74, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742177_1353, duration: 178000
2015-03-13 10:13:09,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0 dst=null perm=null
2015-03-13 10:13:09,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0 dst=null perm=null
2015-03-13 10:13:09,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003 dst=null perm=null
2015-03-13 10:13:09,273 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,273 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63465 dest: /127.0.0.1:60696
2015-03-13 10:13:09,275 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63466 dest: /127.0.0.1:60693
2015-03-13 10:13:09,276 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370 src: /127.0.0.1:63467 dest: /127.0.0.1:60686
2015-03-13 10:13:09,284 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63467, dest: /127.0.0.1:60686, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 6539000
2015-03-13 10:13:09,284 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,285 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,285 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63466, dest: /127.0.0.1:60693, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 7757000
2015-03-13 10:13:09,285 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,286 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63465, dest: /127.0.0.1:60696, bytes: 24, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 8780000
2015-03-13 10:13:09,286 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,287 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,287 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742194_1370{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,291 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000005
2015-03-13 10:13:09,291 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,291 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,291 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000005
2015-03-13 10:13:09,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000004
2015-03-13 10:13:09,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,292 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,292 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,293 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000004
2015-03-13 10:13:09,293 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:09,293 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:09,293 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,293 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,293 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:09,293 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000004 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:09,304 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000005 is : 143
2015-03-13 10:13:09,310 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0030_m_000000_0_-709999944_1
2015-03-13 10:13:09,316 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,317 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,317 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,317 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000005 from application application_1426266260362_0030
2015-03-13 10:13:09,317 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,317 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,317 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,318 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000005
2015-03-13 10:13:09,319 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:09,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0 dst=null perm=null
2015-03-13 10:13:09,326 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0 dst=null perm=null
2015-03-13 10:13:09,332 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000 dst=null perm=null
2015-03-13 10:13:09,336 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:09,349 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000002
2015-03-13 10:13:09,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000005
2015-03-13 10:13:09,350 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,350 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,350 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000005
2015-03-13 10:13:09,350 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:09,350 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:09,350 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,351 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,351 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:09,351 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000005 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:09,365 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000002 is : 143
2015-03-13 10:13:09,377 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,377 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,378 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,378 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,379 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000002
2015-03-13 10:13:09,380 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,380 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,380 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000002 from application application_1426266260362_0030
2015-03-13 10:13:09,380 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,380 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,383 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63468 dest: /127.0.0.1:60686
2015-03-13 10:13:09,384 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63469 dest: /127.0.0.1:60689
2015-03-13 10:13:09,385 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371 src: /127.0.0.1:63470 dest: /127.0.0.1:60693
2015-03-13 10:13:09,393 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63470, dest: /127.0.0.1:60693, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 6152000
2015-03-13 10:13:09,393 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,393 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,394 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63469, dest: /127.0.0.1:60689, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 6656000
2015-03-13 10:13:09,394 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,394 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,394 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63468, dest: /127.0.0.1:60686, bytes: 12, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 7407000
2015-03-13 10:13:09,394 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,395 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742195_1371{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:09,401 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0030_m_000001_0_173823530_1
2015-03-13 10:13:09,410 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0 dst=null perm=null
2015-03-13 10:13:09,416 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0 dst=null perm=null
2015-03-13 10:13:09,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001 dst=null perm=null
2015-03-13 10:13:09,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/_temporary/attempt_1426266260362_0030_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:09,430 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000003
2015-03-13 10:13:09,431 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:09,431 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:09,431 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000002
2015-03-13 10:13:09,431 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:09,431 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:09,432 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:09,432 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:09,432 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000002
2015-03-13 10:13:09,432 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:09,432 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:09,432 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,432 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:09,432 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:09,432 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000002 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:09,433 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000003
2015-03-13 10:13:09,435 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,437 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,441 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1 dst=null perm=null
2015-03-13 10:13:09,446 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0030_01_000003 is : 143
2015-03-13 10:13:09,448 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,449 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000 dst=null perm=null
2015-03-13 10:13:09,451 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2015-03-13 10:13:09,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,457 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001 dst=null perm=null
2015-03-13 10:13:09,459 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:09,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2015-03-13 10:13:09,459 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,460 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,461 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000003
2015-03-13 10:13:09,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,463 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:09,463 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:09,464 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000003 from application application_1426266260362_0030
2015-03-13 10:13:09,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,464 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:09,464 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:09,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002 dst=null perm=null
2015-03-13 10:13:09,466 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2015-03-13 10:13:09,469 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,471 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003 dst=null perm=null
2015-03-13 10:13:09,473 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2015-03-13 10:13:09,474 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,475 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,476 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:09,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004 dst=null perm=null
2015-03-13 10:13:09,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2015-03-13 10:13:09,480 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary/1/task_1426266260362_0030_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,484 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary dst=null perm=null
2015-03-13 10:13:09,487 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,489 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_SUCCESS is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,490 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,492 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,503 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63458, dest: /127.0.0.1:60689, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 421514000
2015-03-13 10:13:09,503 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,504 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,504 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63457, dest: /127.0.0.1:60696, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 421757000
2015-03-13 10:13:09,504 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,505 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,506 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63456, dest: /127.0.0.1:60693, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 423532000
2015-03-13 10:13:09,506 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,506 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742192_1368{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:09,507 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,511 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,513 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63471 dest: /127.0.0.1:60696
2015-03-13 10:13:09,514 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63472 dest: /127.0.0.1:60689
2015-03-13 10:13:09,515 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372 src: /127.0.0.1:63473 dest: /127.0.0.1:60686
2015-03-13 10:13:09,518 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63473, dest: /127.0.0.1:60686, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 1260000
2015-03-13 10:13:09,519 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,519 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,519 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63472, dest: /127.0.0.1:60689, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 1916000
2015-03-13 10:13:09,519 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,520 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63471, dest: /127.0.0.1:60696, bytes: 448, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 2719000
2015-03-13 10:13:09,520 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,520 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742196_1372{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,522 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist dst=null perm=null
2015-03-13 10:13:09,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:09,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist dst=null perm=null
2015-03-13 10:13:09,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:09,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1.jhist dst=null perm=null
2015-03-13 10:13:09,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,541 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63474, bytes: 53758, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368, duration: 169000
2015-03-13 10:13:09,543 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,545 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63475 dest: /127.0.0.1:60689
2015-03-13 10:13:09,546 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63476 dest: /127.0.0.1:60693
2015-03-13 10:13:09,547 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373 src: /127.0.0.1:63477 dest: /127.0.0.1:60686
2015-03-13 10:13:09,550 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63477, dest: /127.0.0.1:60686, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 1126000
2015-03-13 10:13:09,550 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,550 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,550 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63476, dest: /127.0.0.1:60693, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 1743000
2015-03-13 10:13:09,550 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,551 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,551 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63475, dest: /127.0.0.1:60689, bytes: 53338, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, duration: 2434000
2015-03-13 10:13:09,551 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,551 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742197_1373{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,553 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,555 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml dst=null perm=null
2015-03-13 10:13:09,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:09,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml dst=null perm=null
2015-03-13 10:13:09,558 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:09,560 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030/job_1426266260362_0030_1_conf.xml dst=null perm=null
2015-03-13 10:13:09,562 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:09,564 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63478, bytes: 91722, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742190_1366, duration: 267000
2015-03-13 10:13:09,566 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:09,568 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63479 dest: /127.0.0.1:60693
2015-03-13 10:13:09,569 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63480 dest: /127.0.0.1:60696
2015-03-13 10:13:09,570 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374 src: /127.0.0.1:63481 dest: /127.0.0.1:60686
2015-03-13 10:13:09,574 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63481, dest: /127.0.0.1:60686, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 1953000
2015-03-13 10:13:09,574 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:09,574 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,575 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63480, dest: /127.0.0.1:60696, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 2596000
2015-03-13 10:13:09,575 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,576 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63479, dest: /127.0.0.1:60693, bytes: 91010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_674940707_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, duration: 3389000
2015-03-13 10:13:09,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,576 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742198_1374{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:09,576 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:09,578 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_674940707_1
2015-03-13 10:13:09,580 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,586 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:09,592 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:09,592 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0030
2015-03-13 10:13:09,592 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from RUNNING to REMOVING
2015-03-13 10:13:09,592 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0030
2015-03-13 10:13:09,592 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from REMOVING to FINISHING
2015-03-13 10:13:10,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:10,140 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000006
2015-03-13 10:13:10,141 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:10,141 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:10,141 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000006
2015-03-13 10:13:10,141 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60723, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:10,141 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:10,141 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000006, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,142 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:10,142 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000006 on node: host: 10.1.1.144:60723 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:10,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:10,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:10,436 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000003
2015-03-13 10:13:10,436 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:10,436 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:10,436 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000003
2015-03-13 10:13:10,436 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:10,437 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:10,437 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,437 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,437 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:10,437 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000003 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:10,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:10,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:10,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:10,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:10,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:10,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:10,598 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742186_1362 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:13:10,598 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742187_1363 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:13:10,598 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742188_1364 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:10,598 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742189_1365 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:10,599 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742192_1368 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:10,599 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742190_1366 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:13:10,599 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0030 dst=null perm=null
2015-03-13 10:13:10,632 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742165_1341 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:13:10,632 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742167_1343 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:10,632 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742166_1342 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:10,633 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742168_1344 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:10,633 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742163_1339 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:13:10,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/5465953571_upper1_652B74C4C49949258960D85598197DD5 dst=null perm=null
2015-03-13 10:13:10,634 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742179_1355 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:13:10,634 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742181_1357 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:13:10,634 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742180_1356 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:13:10,634 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742182_1358 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:13:10,634 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742177_1353 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:10,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/4979524638_upper1_upper2_6E2D65DD5F264DAC85D7F2DC298957C5 dst=null perm=null
2015-03-13 10:13:10,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,635 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary
2015-03-13 10:13:10,636 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/_temporary dst=null perm=null
2015-03-13 10:13:10,642 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,643 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,644 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,645 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,646 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:10,647 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2015-03-13 10:13:10,648 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 179000
2015-03-13 10:13:10,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2015-03-13 10:13:10,651 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 160000
2015-03-13 10:13:10,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2015-03-13 10:13:10,652 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 115000
2015-03-13 10:13:10,653 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2015-03-13 10:13:10,654 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 144000
2015-03-13 10:13:10,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2015-03-13 10:13:10,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,662 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,663 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,664 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,665 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,666 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:10,667 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2015-03-13 10:13:10,668 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 169000
2015-03-13 10:13:10,668 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2015-03-13 10:13:10,670 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 178000
2015-03-13 10:13:10,670 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2015-03-13 10:13:10,671 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 110000
2015-03-13 10:13:10,672 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2015-03-13 10:13:10,673 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 152000
2015-03-13 10:13:10,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2015-03-13 10:13:10,674 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin
2015-03-13 10:13:10,674 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,675 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin dst=null perm=null
2015-03-13 10:13:10,676 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2015-03-13 10:13:10,677 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00000 dst=null perm=null
2015-03-13 10:13:10,678 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 28, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370, duration: 155000
2015-03-13 10:13:10,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2015-03-13 10:13:10,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00001 dst=null perm=null
2015-03-13 10:13:10,680 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63484, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371, duration: 176000
2015-03-13 10:13:10,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2015-03-13 10:13:10,681 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00002 dst=null perm=null
2015-03-13 10:13:10,682 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367, duration: 169000
2015-03-13 10:13:10,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2015-03-13 10:13:10,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00003 dst=null perm=null
2015-03-13 10:13:10,684 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63486, bytes: 16, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369, duration: 168000
2015-03-13 10:13:10,685 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2015-03-13 10:13:10,686 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsamesourceintojoin/part-00004 dst=null perm=null
2015-03-13 10:13:10,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:10,687 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:10,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:10,688 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:10,698 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,699 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:10,699 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:10,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:10,719 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt"]
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt"]
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt"]
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup"]
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] parallel execution is enabled: true
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] starting jobs: 1
2015-03-13 10:13:10,720 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [cogrouping] allocating threads: 1
2015-03-13 10:13:10,722 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] starting step: (1/1) ...platform/joinsintocogroup
2015-03-13 10:13:10,733 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,740 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:10,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:10,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:10,744 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 31
2015-03-13 10:13:10,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=null
2015-03-13 10:13:10,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:10,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:13:10,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:10,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,750 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:10,751 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63488 dest: /127.0.0.1:60693
2015-03-13 10:13:10,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63489 dest: /127.0.0.1:60686
2015-03-13 10:13:10,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63490 dest: /127.0.0.1:60696
2015-03-13 10:13:10,757 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63490, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 2652000
2015-03-13 10:13:10,758 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,758 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,758 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63489, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 2438000
2015-03-13 10:13:10,758 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,759 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,759 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63488, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 4001000
2015-03-13 10:13:10,759 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,759 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742199_1375{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,760 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,761 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar
2015-03-13 10:13:10,761 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:10,762 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:10,763 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:10,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:10,764 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:13:10,765 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:13:10,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:13:10,766 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:13:10,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:13:10,767 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:10,769 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:10,769 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,770 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:10,771 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:10,771 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:10,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:10,773 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,773 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:10,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:10,774 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:10,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:10,776 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,777 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,778 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split
2015-03-13 10:13:10,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:10,779 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:10,780 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63491 dest: /127.0.0.1:60693
2015-03-13 10:13:10,782 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63492 dest: /127.0.0.1:60689
2015-03-13 10:13:10,783 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63493 dest: /127.0.0.1:60686
2015-03-13 10:13:10,784 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376 src: /127.0.0.1:63494 dest: /127.0.0.1:60696
2015-03-13 10:13:10,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63494, dest: /127.0.0.1:60696, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 1535000
2015-03-13 10:13:10,787 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,787 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,787 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63493, dest: /127.0.0.1:60686, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 1917000
2015-03-13 10:13:10,787 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,788 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63492, dest: /127.0.0.1:60689, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 2752000
2015-03-13 10:13:10,788 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,788 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,789 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63491, dest: /127.0.0.1:60693, bytes: 2133, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 3540000
2015-03-13 10:13:10,789 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,789 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742200_1376{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:10,790 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,791 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,792 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,793 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:10,794 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63495 dest: /127.0.0.1:60689
2015-03-13 10:13:10,795 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63496 dest: /127.0.0.1:60693
2015-03-13 10:13:10,796 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377 src: /127.0.0.1:63497 dest: /127.0.0.1:60686
2015-03-13 10:13:10,799 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63497, dest: /127.0.0.1:60686, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 1254000
2015-03-13 10:13:10,799 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,799 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,800 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63496, dest: /127.0.0.1:60693, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 1589000
2015-03-13 10:13:10,800 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,800 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,804 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63495, dest: /127.0.0.1:60689, bytes: 218, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 2358000
2015-03-13 10:13:10,804 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,805 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742201_1377{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,806 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,806 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:6
2015-03-13 10:13:10,807 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,808 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:10,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:10,816 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:10,817 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:10,821 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:10,822 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63498 dest: /127.0.0.1:60689
2015-03-13 10:13:10,823 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63499 dest: /127.0.0.1:60696
2015-03-13 10:13:10,825 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378 src: /127.0.0.1:63500 dest: /127.0.0.1:60686
2015-03-13 10:13:10,828 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63500, dest: /127.0.0.1:60686, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 1425000
2015-03-13 10:13:10,828 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:10,828 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,828 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63499, dest: /127.0.0.1:60696, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 1875000
2015-03-13 10:13:10,828 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,829 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,829 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63498, dest: /127.0.0.1:60689, bytes: 100870, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 2556000
2015-03-13 10:13:10,829 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:10,830 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742202_1378{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:10,830 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:10,831 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0031
2015-03-13 10:13:10,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=null
2015-03-13 10:13:10,832 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:10,833 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:10,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:10,834 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:10,835 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:10,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:10,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:10,837 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:10,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:10,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:10,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:10,839 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:10,840 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:10,841 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:10,841 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 31 submitted by user soberoi
2015-03-13 10:13:10,841 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0031
2015-03-13 10:13:10,842 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0031
2015-03-13 10:13:10,842 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0031
2015-03-13 10:13:10,842 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from NEW to NEW_SAVING
2015-03-13 10:13:10,842 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:10,842 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,842 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:10,842 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0031 from user: soberoi activated in queue: default
2015-03-13 10:13:10,843 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0031 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:10,843 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0031 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:10,843 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0031 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:10,843 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0031_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:10,843 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:10,844 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:10,845 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0031/
2015-03-13 10:13:10,845 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] submitted hadoop job: job_1426266260362_0031
2015-03-13 10:13:10,845 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [cogrouping] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0031/
2015-03-13 10:13:10,962 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:10,963 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:10,963 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:10,963 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0031_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,963 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:10,963 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:10,964 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:10,965 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0031 AttemptId: appattempt_1426266260362_0031_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ]
2015-03-13 10:13:10,965 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:10,965 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,965 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:10,965 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0031_000001
2015-03-13 10:13:10,966 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,966 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0031_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:13:10,969 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:10,970 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000001 by user soberoi
2015-03-13 10:13:10,970 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:10,970 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:10,970 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:10,971 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000001 to application application_1426266260362_0031
2015-03-13 10:13:10,971 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:10,971 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] for AM appattempt_1426266260362_0031_000001
2015-03-13 10:13:10,971 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:10,971 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:10,971 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:10,971 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,971 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,971 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,972 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:10,972 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000001
2015-03-13 10:13:10,981 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0031_01_000001.tokens. Credentials list:
2015-03-13 10:13:10,996 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:11,064 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/nmPrivate/container_1426266260362_0031_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001.tokens
2015-03-13 10:13:11,065 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:11,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:11,127 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:11,128 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:11,134 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 494000
2015-03-13 10:13:11,152 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:11,170 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:11,171 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:11,177 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63485, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 174000
2015-03-13 10:13:11,189 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:11,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:11,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:11,213 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 2153, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 171000
2015-03-13 10:13:11,226 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:11,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:11,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:11,249 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63483, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1083975904_16473, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 225000
2015-03-13 10:13:11,263 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:11,263 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:11,288 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:11,288 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:11,333 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:11,355 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001/default_container_executor.sh]
2015-03-13 10:13:11,413 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:11,414 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:11,415 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:11,415 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:11,415 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:11,416 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:11,416 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:11,416 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:11,417 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:11,463 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:11,464 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:11,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:11,618 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:11,666 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:11,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742191_1367
2015-03-13 10:13:11,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:11,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742195_1371
2015-03-13 10:13:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742197_1373
2015-03-13 10:13:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:11,668 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742193_1369
2015-03-13 10:13:11,963 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:11,964 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:12,014 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742194_1370
2015-03-13 10:13:12,015 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742198_1374
2015-03-13 10:13:12,015 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:12,016 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372
2015-03-13 10:13:12,016 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742192_1368
2015-03-13 10:13:12,218 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:12,219 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:12,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:12,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:12,967 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:12,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED dst=null perm=null
2015-03-13 10:13:12,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:13:12,990 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_FAIL dst=null perm=null
2015-03-13 10:13:13,041 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=null
2015-03-13 10:13:13,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:13:13,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:13:13,123 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742199_1375 to datanode(s) 127.0.0.1:60689
2015-03-13 10:13:13,123 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742192_1368, blk_1073742177_1353, blk_1073742163_1339, blk_1073742180_1356, blk_1073742165_1341, blk_1073742182_1358, blk_1073742167_1343, blk_1073742168_1344, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365]
2015-03-13 10:13:13,124 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742177_1353, blk_1073742179_1355, blk_1073742180_1356, blk_1073742181_1357, blk_1073742182_1358, blk_1073742186_1362, blk_1073742187_1363, blk_1073742190_1366, blk_1073742192_1368, blk_1073742163_1339, blk_1073742165_1341, blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344]
2015-03-13 10:13:13,334 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:13,341 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:13,341 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:13,396 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63505, bytes: 222, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377, duration: 133000
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:13,887 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:13,888 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:13,889 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:13,967 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:14,078 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 to 127.0.0.1:60689
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:14,079 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:14,080 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 (numBytes=254067) to /127.0.0.1:60689
2015-03-13 10:13:14,080 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63508 dest: /127.0.0.1:60689
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742190 for deletion
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:14,080 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir39/blk_1073742190
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:14,081 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:14,082 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375 src: /127.0.0.1:63508 dest: /127.0.0.1:60689 of size 254067
2015-03-13 10:13:14,082 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:14,083 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:14,083 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:14,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742199_1375 size 254067
2015-03-13 10:13:14,175 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:14,176 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0031_000001
2015-03-13 10:13:14,176 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0031 APPATTEMPTID=appattempt_1426266260362_0031_000001
2015-03-13 10:13:14,176 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:14,176 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from ACCEPTED to RUNNING
2015-03-13 10:13:14,197 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:14,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:14,281 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:14,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:14,410 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:14,446 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63512 dest: /127.0.0.1:60686
2015-03-13 10:13:14,447 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63513 dest: /127.0.0.1:60696
2015-03-13 10:13:14,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379 src: /127.0.0.1:63514 dest: /127.0.0.1:60693
2015-03-13 10:13:14,456 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63514, dest: /127.0.0.1:60693, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 5703000
2015-03-13 10:13:14,456 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:14,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63513, dest: /127.0.0.1:60696, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 6384000
2015-03-13 10:13:14,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:14,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63512, dest: /127.0.0.1:60686, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 7109000
2015-03-13 10:13:14,458 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:14,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742203_1379{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:14,463 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:14,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:15,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:15,351 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,351 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:15,351 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:13:15,351 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,351 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:15,351 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,352 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,352 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:15,352 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:4096, vCores:3> used and <memory:0, vCores:5> available
2015-03-13 10:13:15,352 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,352 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:15,352 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,450 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,451 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:15,451 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:15,451 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,451 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:15,451 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,452 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,452 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:15,452 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:15,452 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,452 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:15,453 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,453 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:15,453 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:15,453 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:13:15,454 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:15,454 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:15,454 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:15,454 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0031_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7 usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,454 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:10240, vCores:8>usedCapacity=0.625, absoluteUsedCapacity=0.625, numApps=2, numContainers=8
2015-03-13 10:13:15,454 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.625 absoluteUsedCapacity=0.625 used=<memory:10240, vCores:8> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:15,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375
2015-03-13 10:13:15,477 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376
2015-03-13 10:13:15,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378
2015-03-13 10:13:15,478 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742201_1377
2015-03-13 10:13:15,731 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0030_01_000001 succeeded
2015-03-13 10:13:15,732 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:15,732 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0030_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:15,739 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0030_01_000001 from application application_1426266260362_0030
2015-03-13 10:13:15,739 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:15,740 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0030
2015-03-13 10:13:15,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,739 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030/container_1426266260362_0030_01_000001
2015-03-13 10:13:15,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,128 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742192_1368, blk_1073742177_1353, blk_1073742179_1355, blk_1073742181_1357, blk_1073742166_1342, blk_1073742167_1343, blk_1073742168_1344, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366]
2015-03-13 10:13:16,128 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742179_1355, blk_1073742163_1339, blk_1073742180_1356, blk_1073742181_1357, blk_1073742165_1341, blk_1073742182_1358, blk_1073742166_1342, blk_1073742186_1362, blk_1073742187_1363, blk_1073742188_1364, blk_1073742189_1365, blk_1073742190_1366]
2015-03-13 10:13:16,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,211 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,212 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:16,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,249 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:16,252 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:16,257 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:16,258 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:16,259 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:16,260 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:16,317 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:16,317 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000002 by user soberoi
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000004 by user soberoi
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000007 by user soberoi
2015-03-13 10:13:16,332 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:16,332 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:16,332 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000005 by user soberoi
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000006 by user soberoi
2015-03-13 10:13:16,332 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000007 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000005 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:16,332 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000002 to application application_1426266260362_0031
2015-03-13 10:13:16,333 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:16,331 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:16,333 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,333 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,333 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,333 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000003 by user soberoi
2015-03-13 10:13:16,331 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0031
2015-03-13 10:13:16,333 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:16,333 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,333 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,332 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000006 to application application_1426266260362_0031
2015-03-13 10:13:16,332 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:16,334 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from NEW to INITING
2015-03-13 10:13:16,334 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000004 to application application_1426266260362_0031
2015-03-13 10:13:16,334 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from INITING to RUNNING
2015-03-13 10:13:16,334 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,333 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:16,334 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000003 to application application_1426266260362_0031
2015-03-13 10:13:16,334 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000002
2015-03-13 10:13:16,334 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:16,335 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,335 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,335 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,335 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,335 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,336 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:16,336 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000003
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,336 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,336 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,336 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,337 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,337 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:16,337 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:16,337 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:16,337 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000007
2015-03-13 10:13:16,337 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000005
2015-03-13 10:13:16,338 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000004
2015-03-13 10:13:16,338 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0031_01_000006
2015-03-13 10:13:16,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 30 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:16,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0030_01_000001
2015-03-13 10:13:16,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,351 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,352 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,352 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,352 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0030_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:16,352 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0030_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:16,352 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0030 CONTAINERID=container_1426266260362_0030_01_000001
2015-03-13 10:13:16,353 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0030_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:16,353 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:8192, vCores:7> numContainers=7 user=soberoi user-resources=<memory:8192, vCores:7>
2015-03-13 10:13:16,353 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0030_01_000001, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:16,353 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0030_000001
2015-03-13 10:13:16,353 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0030_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:16,353 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0030 State change from FINISHING to FINISHED
2015-03-13 10:13:16,354 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0030
2015-03-13 10:13:16,354 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0030,name=[B61955F7F1A34D09B0265BE65DDD3B28/C57B5DBC9F57493FBC8351F3D1E72603] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0030/jobhistory/job/job_1426266260362_0030,appMasterHost=Edinburgh.local,startTime=1426266774213,finishTime=1426266789592,finalStatus=SUCCEEDED
2015-03-13 10:13:16,353 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:16,354 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:7>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=7
2015-03-13 10:13:16,354 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0030_000001 released container container_1426266260362_0030_01_000001 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:16,354 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0030_000001 is done. finalState=FINISHED
2015-03-13 10:13:16,354 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0030 requests cleared
2015-03-13 10:13:16,354 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0030 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:16,354 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0030 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:16,355 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0030_000001
2015-03-13 10:13:16,360 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0030_000001 (auth:SIMPLE)
2015-03-13 10:13:16,362 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0030_01_000001
2015-03-13 10:13:16,363 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0031_01_000002.tokens. Credentials list:
2015-03-13 10:13:16,364 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000005.tokens. Credentials list:
2015-03-13 10:13:16,364 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0031_01_000003.tokens. Credentials list:
2015-03-13 10:13:16,365 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0031_01_000006.tokens. Credentials list:
2015-03-13 10:13:16,365 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0031_01_000007.tokens. Credentials list:
2015-03-13 10:13:16,365 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000004.tokens. Credentials list:
2015-03-13 10:13:16,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:16,382 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:16,451 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,451 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,451 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,452 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:16,452 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:16,453 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:16,453 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:16,454 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:16,454 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:16,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,454 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:16,469 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005.tokens
2015-03-13 10:13:16,469 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:16,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0031_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002.tokens
2015-03-13 10:13:16,471 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:16,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,540 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar dst=null perm=null
2015-03-13 10:13:16,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63523, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-353960031_16621, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 519000
2015-03-13 10:13:16,547 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63522, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2105913678_16622, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742199_1375, duration: 546000
2015-03-13 10:13:16,571 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,571 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,592 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,593 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml dst=null perm=null
2015-03-13 10:13:16,600 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63523, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-2105913678_16622, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 243000
2015-03-13 10:13:16,600 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63522, bytes: 101662, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-353960031_16621, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742202_1378, duration: 299000
2015-03-13 10:13:16,614 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,614 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:16,628 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:16,667 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:16,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:16,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190 for deletion
2015-03-13 10:13:16,668 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742192_1368 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742192
2015-03-13 10:13:16,669 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:16,669 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:16,669 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742168_1344 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742168
2015-03-13 10:13:16,669 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:16,669 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:16,670 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190
2015-03-13 10:13:16,670 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742177_1353 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742177
2015-03-13 10:13:16,670 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:16,670 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742167_1343 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742167
2015-03-13 10:13:16,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:16,671 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186 for deletion
2015-03-13 10:13:16,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187 for deletion
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188 for deletion
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742163_1339 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742163
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189 for deletion
2015-03-13 10:13:16,684 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742179_1355 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742179
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742180_1356 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742180
2015-03-13 10:13:16,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742165_1341 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742165
2015-03-13 10:13:16,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742166_1342 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742166
2015-03-13 10:13:16,684 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190 for deletion
2015-03-13 10:13:16,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742182_1358 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742182
2015-03-13 10:13:16,685 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742181_1357 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742181
2015-03-13 10:13:16,686 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742187_1363 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742187
2015-03-13 10:13:16,686 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742186_1362 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742186
2015-03-13 10:13:16,686 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742189_1365 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742189
2015-03-13 10:13:16,686 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742188_1364 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742188
2015-03-13 10:13:16,686 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742190_1366 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742190
2015-03-13 10:13:16,686 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,686 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,687 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,687 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,687 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,687 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,689 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,689 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,689 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,689 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,693 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:16,693 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:16,831 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006/default_container_executor.sh]
2015-03-13 10:13:16,842 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004/default_container_executor.sh]
2015-03-13 10:13:16,864 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007/default_container_executor.sh]
2015-03-13 10:13:16,868 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005/default_container_executor.sh]
2015-03-13 10:13:16,872 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002/default_container_executor.sh]
2015-03-13 10:13:16,875 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003/default_container_executor.sh]
2015-03-13 10:13:16,969 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,163 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:17,164 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,164 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:17,164 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:17,164 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:17,164 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,165 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,165 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,227 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379
2015-03-13 10:13:17,228 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:13:17,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,352 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,353 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:17,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0030
2015-03-13 10:13:17,353 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0030 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:17,353 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0030, with delay of 10800 seconds
2015-03-13 10:13:17,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,353 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0030
2015-03-13 10:13:17,456 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,456 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:17,641 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,641 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0031_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003.tokens
2015-03-13 10:13:17,777 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:17,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0031_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004.tokens
2015-03-13 10:13:17,778 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:17,883 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:17,973 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0031_01_000007.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007.tokens
2015-03-13 10:13:18,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:18,120 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:18,249 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0031_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006.tokens
2015-03-13 10:13:18,250 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:18,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,460 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,461 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:18,974 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,360 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,360 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,463 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,463 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,464 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,464 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:19,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,363 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,364 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,465 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,466 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:20,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,364 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,471 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,472 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:21,978 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,368 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,475 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:22,984 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,374 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,374 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,481 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:23,986 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,378 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,486 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,487 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,487 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:24,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,383 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,384 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:25,988 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,294 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,386 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,388 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,417 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,477 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,494 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:26,512 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63538, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 168000
2015-03-13 10:13:26,568 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job.split dst=null perm=null
2015-03-13 10:13:26,585 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63540, bytes: 2153, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 193000
2015-03-13 10:13:26,613 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63541, bytes: 605, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 1536, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 182000
2015-03-13 10:13:26,630 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63543, bytes: 1637, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 512, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 178000
2015-03-13 10:13:26,647 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63544, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 175000
2015-03-13 10:13:26,704 INFO hs.JobHistory (JobHistory.java:run(178)) - Starting scan to move intermediate done files
2015-03-13 10:13:26,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:26,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:13:26,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:13:26,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary dst=null perm=null
2015-03-13 10:13:26,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary dst=null perm=null
2015-03-13 10:13:26,710 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary dst=null perm=null
2015-03-13 10:13:26,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63548, bytes: 415, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742092_1268, duration: 161000
2015-03-13 10:13:26,712 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0022,submitTime=1426266637614,launchTime=1426266640995,firstMapTaskLaunchTime=1426266643151,firstReduceTaskLaunchTime=0,finishTime=1426266652550,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[5C1ADEBEAF9544CFBB574223654F352B/C41347FCE26941FD99688B6E707F843A] lower*upper/(2/2)
2015-03-13 10:13:26,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63549, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742078_1254, duration: 133000
2015-03-13 10:13:26,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63547, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742105_1281, duration: 99000
2015-03-13 10:13:26,713 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0021,submitTime=1426266621046,launchTime=1426266624516,firstMapTaskLaunchTime=1426266626691,firstReduceTaskLaunchTime=0,finishTime=1426266636276,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=46,reduceSlotSeconds=0,jobName=[5665C2AB3C80426983CDE9B8E87C8DA6/3A3A52572DE2469599E707FB097F70CF] lower*upper/(1/1) ...dedpipesplatform/joinnone
2015-03-13 10:13:26,712 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0023,submitTime=1426266653789,launchTime=1426266657150,firstMapTaskLaunchTime=1426266659312,firstReduceTaskLaunchTime=0,finishTime=1426266669026,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[5C1ADEBEAF9544CFBB574223654F352B/D216C764973C483CA6D2DDC3E72E5438] lower*upper/(1/2) ...dedpipesplatform/joinself
2015-03-13 10:13:26,713 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary]
2015-03-13 10:13:26,712 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary]
2015-03-13 10:13:26,713 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary]
2015-03-13 10:13:26,718 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742105_1281 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:26,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023.summary dst=null perm=null
2015-03-13 10:13:26,718 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742092_1268 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:13:26,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022.summary dst=null perm=null
2015-03-13 10:13:26,718 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742078_1254 127.0.0.1:60693 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:26,719 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021.summary dst=null perm=null
2015-03-13 10:13:26,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,720 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,721 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,721 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,721 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,721 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023-1426266653789-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FD216C764973C483C-1426266669026-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021-1426266621046-soberoi-%5B5665C2AB3C80426983CDE9B8E87C8DA6%2F3A3A52572DE24695-1426266636276-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023_conf.xml
2015-03-13 10:13:26,722 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022-1426266637614-soberoi-%5B5C1ADEBEAF9544CFBB574223654F352B%2FC41347FCE26941FD-1426266652550-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,722 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021_conf.xml
2015-03-13 10:13:26,723 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022_conf.xml
2015-03-13 10:13:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0023_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0023_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0022_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0022_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,723 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0021_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0021_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary dst=null perm=null
2015-03-13 10:13:26,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary dst=null perm=null
2015-03-13 10:13:26,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary dst=null perm=null
2015-03-13 10:13:26,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63552, bytes: 430, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742142_1318, duration: 173000
2015-03-13 10:13:26,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63550, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742132_1308, duration: 339000
2015-03-13 10:13:26,726 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0024,submitTime=1426266670375,launchTime=1426266673648,firstMapTaskLaunchTime=1426266675804,firstReduceTaskLaunchTime=0,finishTime=1426266685513,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[716001CDD2B94A3FADE59C5DF8875A2D/4BC832EC1D1E4858AE3D38200A23E3C1] upper2*lower*upper1/(2/2)
2015-03-13 10:13:26,726 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63551, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742119_1295, duration: 197000
2015-03-13 10:13:26,726 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary]
2015-03-13 10:13:26,726 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0025,submitTime=1426266686752,launchTime=1426266690149,firstMapTaskLaunchTime=1426266692306,firstReduceTaskLaunchTime=0,finishTime=1426266702150,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=48,reduceSlotSeconds=0,jobName=[716001CDD2B94A3FADE59C5DF8875A2D/9FD5B5C1ECE64C749C8E187DBF5C6990] upper2*lower*upper1/(1/2) ...orm/joinaroundjoinswapped
2015-03-13 10:13:26,727 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary]
2015-03-13 10:13:26,726 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0026,submitTime=1426266703493,launchTime=1426266706853,firstMapTaskLaunchTime=1426266709012,firstReduceTaskLaunchTime=1426266720953,finishTime=1426266723843,resourcesPerMap=1024,resourcesPerReduce=1024,numMaps=5,numReduces=1,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=2,jobName=[D22FDB06DDD24032BF29C6EAE9E54D4B/116CA5A33C1047FAA2216FF3C2C5902D] lower*upper/(2/2)
2015-03-13 10:13:26,727 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary]
2015-03-13 10:13:26,731 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742119_1295 127.0.0.1:60696 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:13:26,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024.summary dst=null perm=null
2015-03-13 10:13:26,731 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742142_1318 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:13:26,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026.summary dst=null perm=null
2015-03-13 10:13:26,731 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742132_1308 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:13:26,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025.summary dst=null perm=null
2015-03-13 10:13:26,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,734 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,734 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist
2015-03-13 10:13:26,734 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024-1426266670375-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F4BC832EC1D1E4858-1426266685513-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025-1426266686752-soberoi-%5B716001CDD2B94A3FADE59C5DF8875A2D%2F9FD5B5C1ECE64C74-1426266702150-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,735 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024_conf.xml
2015-03-13 10:13:26,735 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026-1426266703493-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F116CA5A33C1047FA-1426266723843-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,736 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025_conf.xml
2015-03-13 10:13:26,736 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026_conf.xml
2015-03-13 10:13:26,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0024_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0024_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0026_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0026_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0025_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0025_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary dst=null perm=null
2015-03-13 10:13:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary dst=null perm=null
2015-03-13 10:13:26,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary dst=null perm=null
2015-03-13 10:13:26,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63552, bytes: 444, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742155_1331, duration: 112000
2015-03-13 10:13:26,738 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63550, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742169_1345, duration: 150000
2015-03-13 10:13:26,738 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0027,submitTime=1426266725092,launchTime=1426266728780,firstMapTaskLaunchTime=1426266730941,firstReduceTaskLaunchTime=0,finishTime=1426266740198,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[D22FDB06DDD24032BF29C6EAE9E54D4B/55AECEF510524BE28EDC4742DCE94B2F] lower*upper/(1/2) ...atform/joinfilteredbranch
2015-03-13 10:13:26,739 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary]
2015-03-13 10:13:26,738 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0028,submitTime=1426266741548,launchTime=1426266744942,firstMapTaskLaunchTime=1426266747098,firstReduceTaskLaunchTime=0,finishTime=1426266756416,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=45,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/31E34ADFFB5F45C187BD485C865354E1] lower*upper1*upper2/(3/3)
2015-03-13 10:13:26,739 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary]
2015-03-13 10:13:26,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63553, bytes: 423, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742183_1359, duration: 174000
2015-03-13 10:13:26,739 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0029,submitTime=1426266757667,launchTime=1426266760938,firstMapTaskLaunchTime=1426266763100,firstReduceTaskLaunchTime=0,finishTime=1426266772967,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/8EF7DC42A1E14629BD263FCEE1EED9A7] lower*upper1*upper2/(2/3)
2015-03-13 10:13:26,739 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary]
2015-03-13 10:13:26,739 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742155_1331 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:13:26,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027.summary dst=null perm=null
2015-03-13 10:13:26,740 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742183_1359 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60696
2015-03-13 10:13:26,740 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742169_1345 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:13:26,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029.summary dst=null perm=null
2015-03-13 10:13:26,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028.summary dst=null perm=null
2015-03-13 10:13:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,742 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,742 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,743 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027-1426266725092-soberoi-%5BD22FDB06DDD24032BF29C6EAE9E54D4B%2F55AECEF510524BE2-1426266740198-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028-1426266741548-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F31E34ADFFB5F45C1-1426266756416-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,743 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027_conf.xml
2015-03-13 10:13:26,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029-1426266757667-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2F8EF7DC42A1E14629-1426266772967-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,744 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028_conf.xml
2015-03-13 10:13:26,744 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029_conf.xml
2015-03-13 10:13:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0027_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0027_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0029_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0029_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0028_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0028_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,745 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary dst=null perm=null
2015-03-13 10:13:26,746 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63548, bytes: 452, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1016390426_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742196_1372, duration: 146000
2015-03-13 10:13:26,746 INFO jobhistory.JobSummary (HistoryFileManager.java:moveToDone(367)) - jobId=job_1426266260362_0030,submitTime=1426266774213,launchTime=1426266777603,firstMapTaskLaunchTime=1426266779751,firstReduceTaskLaunchTime=0,finishTime=1426266789493,resourcesPerMap=1024,resourcesPerReduce=0,numMaps=5,numReduces=0,user=soberoi,queue=default,status=SUCCEEDED,mapSlotSeconds=47,reduceSlotSeconds=0,jobName=[B61955F7F1A34D09B0265BE65DDD3B28/C57B5DBC9F57493FBC8351F3D1E72603] lower*upper1*upper2/(1/3) ...rm/joinsamesourceintojoin
2015-03-13 10:13:26,747 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDone(368)) - Deleting JobSummary file: [hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary]
2015-03-13 10:13:26,748 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742196_1372 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686
2015-03-13 10:13:26,748 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030.summary dst=null perm=null
2015-03-13 10:13:26,749 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63545, bytes: 1121, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742200_1376, duration: 153000
2015-03-13 10:13:26,750 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000 dst=null perm=null
2015-03-13 10:13:26,750 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist
2015-03-13 10:13:26,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030-1426266774213-soberoi-%5BB61955F7F1A34D09B0265BE65DDD3B28%2FC57B5DBC9F57493F-1426266789493-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,755 INFO hs.HistoryFileManager (HistoryFileManager.java:moveToDoneNow(863)) - Moving hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml to hdfs://localhost:60685/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030_conf.xml
2015-03-13 10:13:26,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename options=0 src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0030_conf.xml dst=/tmp/hadoop-yarn/staging/history/done/2015/03/13/000000/job_1426266260362_0030_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:26,774 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:26,777 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63541, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 145000
2015-03-13 10:13:26,778 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs.txt dst=null perm=null
2015-03-13 10:13:26,782 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63554, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 149000
2015-03-13 10:13:26,805 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:26,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:26,849 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63555, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 160000
2015-03-13 10:13:26,887 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:26,891 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63556, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 155000
2015-03-13 10:13:26,994 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,380 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,390 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,425 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,430 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,433 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,439 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63557, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 160000
2015-03-13 10:13:27,444 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63538, bytes: 56, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000000_0_-2106661709_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741912_1088, duration: 166000
2015-03-13 10:13:27,450 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,454 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,460 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,467 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,470 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs.txt dst=null perm=null
2015-03-13 10:13:27,472 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63558, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000005_0_-464622655_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:13:27,475 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63559, bytes: 55, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000001_0_-122747551_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741913_1089, duration: 138000
2015-03-13 10:13:27,489 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000005_0 dst=null perm=null
2015-03-13 10:13:27,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000000_0 dst=null perm=null
2015-03-13 10:13:27,530 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:27,530 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:27,532 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000002
2015-03-13 10:13:27,532 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,532 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,532 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000002
2015-03-13 10:13:27,532 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000007
2015-03-13 10:13:27,532 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,532 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,533 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,546 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000002 is : 143
2015-03-13 10:13:27,547 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000007 is : 143
2015-03-13 10:13:27,550 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:27,552 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63563 dest: /127.0.0.1:60693
2015-03-13 10:13:27,553 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63564 dest: /127.0.0.1:60686
2015-03-13 10:13:27,555 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380 src: /127.0.0.1:63565 dest: /127.0.0.1:60696
2015-03-13 10:13:27,558 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,559 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,559 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,559 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,559 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000007 from application application_1426266260362_0031
2015-03-13 10:13:27,559 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,560 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,560 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,560 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist for DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:27,559 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000002 from application application_1426266260362_0031
2015-03-13 10:13:27,561 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,561 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000007
2015-03-13 10:13:27,561 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,559 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000002
2015-03-13 10:13:27,565 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,571 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63566, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 138000
2015-03-13 10:13:27,577 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63566, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000002_0_-305312229_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 177000
2015-03-13 10:13:27,579 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,582 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63567, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000004_0_605245946_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 149000
2015-03-13 10:13:27,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000001_0 dst=null perm=null
2015-03-13 10:13:27,604 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,605 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000003
2015-03-13 10:13:27,605 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,605 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000002
2015-03-13 10:13:27,605 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,605 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,606 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,606 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000002
2015-03-13 10:13:27,606 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:27,606 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:13:27,606 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,606 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,606 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=1, numContainers=6
2015-03-13 10:13:27,606 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:27,617 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000003 is : 143
2015-03-13 10:13:27,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000002_0 dst=null perm=null
2015-03-13 10:13:27,626 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,629 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,630 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,631 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,631 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,632 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000003
2015-03-13 10:13:27,633 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:27,634 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,634 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000003 from application application_1426266260362_0031
2015-03-13 10:13:27,634 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,634 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,637 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000004
2015-03-13 10:13:27,637 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,637 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,637 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000004
2015-03-13 10:13:27,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,638 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000007
2015-03-13 10:13:27,639 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,639 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,639 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000007
2015-03-13 10:13:27,639 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:27,639 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:27,639 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,639 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,639 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:27,639 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000007 on node: host: 10.1.1.144:60711 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:27,650 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000004 is : 143
2015-03-13 10:13:27,651 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000004_0 dst=null perm=null
2015-03-13 10:13:27,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,659 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/upper.txt dst=null perm=null
2015-03-13 10:13:27,660 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000006
2015-03-13 10:13:27,660 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,660 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: -1000
2015-03-13 10:13:27,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,661 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:27,662 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,662 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,662 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000004
2015-03-13 10:13:27,663 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000006
2015-03-13 10:13:27,668 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63568, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0031_m_000003_0_1621922467_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741828_1004, duration: 132000
2015-03-13 10:13:27,677 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000006 is : 143
2015-03-13 10:13:27,688 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,688 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,689 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,689 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000004 from application application_1426266260362_0031
2015-03-13 10:13:27,689 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,689 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,689 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,690 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,691 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000006 from application application_1426266260362_0031
2015-03-13 10:13:27,691 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,691 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,696 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_m_000003_0 dst=null perm=null
2015-03-13 10:13:27,702 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000005
2015-03-13 10:13:27,702 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:27,702 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,702 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000004
2015-03-13 10:13:27,702 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:27,703 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000005
2015-03-13 10:13:27,703 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:27,703 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:27,703 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000006
2015-03-13 10:13:27,703 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,703 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,704 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000004
2015-03-13 10:13:27,704 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:27,704 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:27,704 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,704 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,704 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:27,704 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000004 on node: host: 10.1.1.144:60711 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:27,704 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:27,704 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:27,704 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000006
2015-03-13 10:13:27,704 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:27,705 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:27,705 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,705 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:27,705 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:27,705 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000006 on node: host: 10.1.1.144:60711 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:27,713 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000005 is : 143
2015-03-13 10:13:27,725 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:27,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,725 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:27,726 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:27,726 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000005 from application application_1426266260362_0031
2015-03-13 10:13:27,727 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:27,727 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:27,995 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:28,139 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742196_1372, blk_1073742132_1308, blk_1073742119_1295, blk_1073742105_1281, blk_1073742155_1331, blk_1073742092_1268, blk_1073742078_1254]
2015-03-13 10:13:28,140 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742196_1372, blk_1073742183_1359, blk_1073742169_1345, blk_1073742105_1281, blk_1073742155_1331, blk_1073742142_1318]
2015-03-13 10:13:28,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:28,606 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000003
2015-03-13 10:13:28,606 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:28,606 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:28,607 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000003
2015-03-13 10:13:28,607 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:28,607 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:28,607 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,607 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,607 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:28,607 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000003 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:28,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:28,672 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:28,673 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:28,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:28,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:28,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:28,674 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:28,693 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:28,693 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:28,693 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:28,693 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:28,694 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:28,695 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:28,705 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:28,705 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000005
2015-03-13 10:13:28,705 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:28,705 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:28,706 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000005
2015-03-13 10:13:28,706 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:28,706 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:28,706 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,706 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:28,706 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:28,706 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000005 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:28,996 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:29,611 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:29,611 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:29,611 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:29,611 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0031 container=Container: [ContainerId: container_1426266260362_0031_01_000008, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0031_01_000008 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:29,612 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:29,612 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:30,001 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:30,289 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:30,297 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0031_01_000008 by user soberoi
2015-03-13 10:13:30,297 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:30,297 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0031_01_000008 to application application_1426266260362_0031
2015-03-13 10:13:30,298 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from NEW to LOCALIZING
2015-03-13 10:13:30,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0031
2015-03-13 10:13:30,298 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0031
2015-03-13 10:13:30,298 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:30,298 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0031
2015-03-13 10:13:30,298 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:30,327 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:30,327 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:30,392 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008/default_container_executor.sh]
2015-03-13 10:13:30,614 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:30,614 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:31,006 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:31,143 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742196_1372, blk_1073742132_1308, blk_1073742183_1359, blk_1073742119_1295, blk_1073742169_1345, blk_1073742105_1281, blk_1073742092_1268, blk_1073742142_1318, blk_1073742078_1254]
2015-03-13 10:13:31,144 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742132_1308, blk_1073742183_1359, blk_1073742119_1295, blk_1073742169_1345, blk_1073742155_1331, blk_1073742092_1268, blk_1073742142_1318, blk_1073742078_1254]
2015-03-13 10:13:31,296 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:13:31,615 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:31,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:31,899 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155 for deletion
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:31,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742155_1331 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742155
2015-03-13 10:13:31,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:31,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:31,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:31,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:32,011 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132 for deletion
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196 for deletion
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119 for deletion
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742132_1308 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742132
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183 for deletion
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742196_1372 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742196
2015-03-13 10:13:32,099 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105 for deletion
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169 for deletion
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092 for deletion
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742119_1295 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742119
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078 for deletion
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142 for deletion
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742183_1359 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742183
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742078_1254 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742078
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742105_1281 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742105
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742142_1318 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742142
2015-03-13 10:13:32,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742169_1345 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742169
2015-03-13 10:13:32,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742092_1268 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742092
2015-03-13 10:13:32,620 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:32,772 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,827 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:32,886 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63575 dest: /127.0.0.1:60696
2015-03-13 10:13:32,888 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63576 dest: /127.0.0.1:60689
2015-03-13 10:13:32,889 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381 src: /127.0.0.1:63577 dest: /127.0.0.1:60686
2015-03-13 10:13:32,899 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63577, dest: /127.0.0.1:60686, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 9221000
2015-03-13 10:13:32,900 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:32,900 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,900 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63576, dest: /127.0.0.1:60689, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 9859000
2015-03-13 10:13:32,900 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,901 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,901 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63575, dest: /127.0.0.1:60696, bytes: 592, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 10614000
2015-03-13 10:13:32,901 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,901 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742205_1381{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:32,904 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0031_r_000000_0_704706670_1
2015-03-13 10:13:32,912 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0 dst=null perm=null
2015-03-13 10:13:32,918 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0 dst=null perm=null
2015-03-13 10:13:32,919 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000 dst=null perm=null
2015-03-13 10:13:32,922 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/_temporary/attempt_1426266260362_0031_r_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:32,932 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from RUNNING to KILLING
2015-03-13 10:13:32,932 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000008
2015-03-13 10:13:32,932 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:32,937 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,939 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,943 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0031_01_000008 is : 143
2015-03-13 10:13:32,943 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1 dst=null perm=null
2015-03-13 10:13:32,949 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:32,950 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:32,951 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000 dst=null perm=null
2015-03-13 10:13:32,953 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2015-03-13 10:13:32,955 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:32,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:32,955 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000008 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:32,955 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000008
2015-03-13 10:13:32,956 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000008 from application application_1426266260362_0031
2015-03-13 10:13:32,956 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:32,956 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:32,956 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary/1/task_1426266260362_0031_r_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary dst=null perm=null
2015-03-13 10:13:32,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,966 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,968 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:32,972 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,987 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63565, dest: /127.0.0.1:60696, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5430210000
2015-03-13 10:13:32,987 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:32,991 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,991 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63564, dest: /127.0.0.1:60686, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5434386000
2015-03-13 10:13:32,992 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,993 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63563, dest: /127.0.0.1:60693, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 5435913000
2015-03-13 10:13:32,993 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:32,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,994 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742204_1380{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:32,996 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:32,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,000 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:33,002 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63578 dest: /127.0.0.1:60689
2015-03-13 10:13:33,003 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63579 dest: /127.0.0.1:60686
2015-03-13 10:13:33,004 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382 src: /127.0.0.1:63580 dest: /127.0.0.1:60693
2015-03-13 10:13:33,006 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63580, dest: /127.0.0.1:60693, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 1075000
2015-03-13 10:13:33,006 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,007 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,007 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63579, dest: /127.0.0.1:60686, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 1574000
2015-03-13 10:13:33,007 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,007 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,008 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63578, dest: /127.0.0.1:60689, bytes: 454, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, duration: 2315000
2015-03-13 10:13:33,008 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,008 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742206_1382{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,010 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,013 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,014 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:33,019 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist dst=null perm=null
2015-03-13 10:13:33,020 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:33,023 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist dst=null perm=null
2015-03-13 10:13:33,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:33,025 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1.jhist dst=null perm=null
2015-03-13 10:13:33,026 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,029 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63581, bytes: 75319, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380, duration: 312000
2015-03-13 10:13:33,030 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:33,032 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63582 dest: /127.0.0.1:60696
2015-03-13 10:13:33,033 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63583 dest: /127.0.0.1:60686
2015-03-13 10:13:33,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383 src: /127.0.0.1:63584 dest: /127.0.0.1:60693
2015-03-13 10:13:33,038 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63584, dest: /127.0.0.1:60693, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 1831000
2015-03-13 10:13:33,038 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,038 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,038 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63583, dest: /127.0.0.1:60686, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 2393000
2015-03-13 10:13:33,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,039 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63582, dest: /127.0.0.1:60696, bytes: 74735, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, duration: 3140000
2015-03-13 10:13:33,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742207_1383{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:33,041 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,044 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml dst=null perm=null
2015-03-13 10:13:33,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:33,045 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml dst=null perm=null
2015-03-13 10:13:33,046 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:33,047 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031/job_1426266260362_0031_1_conf.xml dst=null perm=null
2015-03-13 10:13:33,048 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:33,050 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63581, bytes: 93941, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742203_1379, duration: 245000
2015-03-13 10:13:33,051 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:33,052 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63585 dest: /127.0.0.1:60686
2015-03-13 10:13:33,054 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63586 dest: /127.0.0.1:60693
2015-03-13 10:13:33,055 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384 src: /127.0.0.1:63587 dest: /127.0.0.1:60689
2015-03-13 10:13:33,057 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63587, dest: /127.0.0.1:60689, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 1662000
2015-03-13 10:13:33,057 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:33,058 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,058 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63586, dest: /127.0.0.1:60693, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 2233000
2015-03-13 10:13:33,058 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,058 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,059 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63585, dest: /127.0.0.1:60686, bytes: 93209, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-145669230_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, duration: 2895000
2015-03-13 10:13:33,059 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:33,059 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742208_1384{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:33,061 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-145669230_1
2015-03-13 10:13:33,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,064 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,068 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0031-1426266790841-soberoi-%5B362219F930134AB6824D0C362D17B53B%2F9DE4798541024E2F-1426266812972-6-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:33,074 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:33,074 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0031
2015-03-13 10:13:33,074 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from RUNNING to REMOVING
2015-03-13 10:13:33,074 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0031
2015-03-13 10:13:33,074 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from REMOVING to FINISHING
2015-03-13 10:13:33,937 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 8 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:33,937 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000008
2015-03-13 10:13:33,937 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000008 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:33,938 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000008 in state: COMPLETED event:FINISHED
2015-03-13 10:13:33,938 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000008
2015-03-13 10:13:33,938 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000008 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:33,938 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:33,938 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000008, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:33,938 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:33,939 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:33,939 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000008 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:34,019 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:34,085 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742199_1375 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:34,086 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742200_1376 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:13:34,086 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742201_1377 127.0.0.1:60689 127.0.0.1:60693 127.0.0.1:60686
2015-03-13 10:13:34,086 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742202_1378 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60686
2015-03-13 10:13:34,086 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742204_1380 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:13:34,086 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742203_1379 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:13:34,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0031 dst=null perm=null
2015-03-13 10:13:34,114 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,115 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary
2015-03-13 10:13:34,115 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/_temporary dst=null perm=null
2015-03-13 10:13:34,121 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,122 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,123 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,124 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,125 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,125 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2015-03-13 10:13:34,127 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 189000
2015-03-13 10:13:34,133 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,134 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,135 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,136 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,137 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,137 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2015-03-13 10:13:34,138 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 168000
2015-03-13 10:13:34,139 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup
2015-03-13 10:13:34,139 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,140 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup dst=null perm=null
2015-03-13 10:13:34,141 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2015-03-13 10:13:34,142 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joinsintocogroup/part-00000 dst=null perm=null
2015-03-13 10:13:34,144 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63589, bytes: 600, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381, duration: 180000
2015-03-13 10:13:34,144 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:34,144 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378]
2015-03-13 10:13:34,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,145 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,146 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,147 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:34,148 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63590 dest: /127.0.0.1:60696
2015-03-13 10:13:34,149 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63591 dest: /127.0.0.1:60689
2015-03-13 10:13:34,150 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385 src: /127.0.0.1:63592 dest: /127.0.0.1:60693
2015-03-13 10:13:34,153 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63592, dest: /127.0.0.1:60693, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 1192000
2015-03-13 10:13:34,153 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,153 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63591, dest: /127.0.0.1:60689, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 1404000
2015-03-13 10:13:34,153 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,154 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,154 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63590, dest: /127.0.0.1:60696, bytes: 83, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 2059000
2015-03-13 10:13:34,154 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,154 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742209_1385{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,155 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,157 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,158 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt. BP-1005356445-10.1.1.144-1426266257849 blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:34,159 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63593 dest: /127.0.0.1:60693
2015-03-13 10:13:34,160 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63594 dest: /127.0.0.1:60689
2015-03-13 10:13:34,161 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386 src: /127.0.0.1:63595 dest: /127.0.0.1:60686
2015-03-13 10:13:34,164 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63595, dest: /127.0.0.1:60686, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 1269000
2015-03-13 10:13:34,164 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,164 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,165 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63594, dest: /127.0.0.1:60689, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 1675000
2015-03-13 10:13:34,165 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,165 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63593, dest: /127.0.0.1:60693, bytes: 48, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 2225000
2015-03-13 10:13:34,165 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,165 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742210_1386{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,167 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,179 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,180 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:34,181 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:34,198 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:34,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting
2015-03-13 10:13:34,199 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt"]
2015-03-13 10:13:34,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] source: Hfs["TextDelimited[['num', 'char' | Integer, String]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt"]
2015-03-13 10:13:34,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] sink: Hfs["TextDelimited[[0:3]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner"]
2015-03-13 10:13:34,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] parallel execution is enabled: true
2015-03-13 10:13:34,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] starting jobs: 1
2015-03-13 10:13:34,200 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lower*upper] allocating threads: 1
2015-03-13 10:13:34,201 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] starting step: (1/1) ...edpipesplatform/joininner
2015-03-13 10:13:34,208 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,216 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:34,217 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:34,218 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:34,220 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 32
2015-03-13 10:13:34,220 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=null
2015-03-13 10:13:34,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:34,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:13:34,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,224 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,225 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:34,227 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63597 dest: /127.0.0.1:60693
2015-03-13 10:13:34,228 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63598 dest: /127.0.0.1:60689
2015-03-13 10:13:34,229 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63599 dest: /127.0.0.1:60686
2015-03-13 10:13:34,233 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63599, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 1947000
2015-03-13 10:13:34,233 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,233 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,233 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63598, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 2724000
2015-03-13 10:13:34,233 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,234 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,234 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63597, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 3234000
2015-03-13 10:13:34,234 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,235 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742211_1387{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:34,236 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,236 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar
2015-03-13 10:13:34,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,237 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,238 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:34,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:34,239 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:34,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:13:34,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:13:34,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:13:34,241 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:13:34,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:13:34,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:34,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,244 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:34,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:34,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,247 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split
2015-03-13 10:13:34,248 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,249 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:34,250 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63600 dest: /127.0.0.1:60693
2015-03-13 10:13:34,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63601 dest: /127.0.0.1:60686
2015-03-13 10:13:34,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63602 dest: /127.0.0.1:60696
2015-03-13 10:13:34,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388 src: /127.0.0.1:63603 dest: /127.0.0.1:60689
2015-03-13 10:13:34,255 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63603, dest: /127.0.0.1:60689, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 1599000
2015-03-13 10:13:34,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,256 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63602, dest: /127.0.0.1:60696, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 1794000
2015-03-13 10:13:34,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,257 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63601, dest: /127.0.0.1:60686, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 2673000
2015-03-13 10:13:34,257 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,257 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63600, dest: /127.0.0.1:60693, bytes: 1807, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 3055000
2015-03-13 10:13:34,258 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,258 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742212_1388{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,259 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,261 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,263 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:34,264 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63604 dest: /127.0.0.1:60689
2015-03-13 10:13:34,265 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63605 dest: /127.0.0.1:60696
2015-03-13 10:13:34,266 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389 src: /127.0.0.1:63606 dest: /127.0.0.1:60693
2015-03-13 10:13:34,268 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63606, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 949000
2015-03-13 10:13:34,268 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,269 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,269 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63605, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 1178000
2015-03-13 10:13:34,269 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,269 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,270 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63604, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 1955000
2015-03-13 10:13:34,270 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,270 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742213_1389{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:34,271 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,271 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:13:34,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:34,274 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:34,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:34,275 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:34,285 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:34,286 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63607 dest: /127.0.0.1:60696
2015-03-13 10:13:34,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63608 dest: /127.0.0.1:60686
2015-03-13 10:13:34,288 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390 src: /127.0.0.1:63609 dest: /127.0.0.1:60689
2015-03-13 10:13:34,291 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63609, dest: /127.0.0.1:60689, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 1564000
2015-03-13 10:13:34,291 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:34,291 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,292 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63608, dest: /127.0.0.1:60686, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 2081000
2015-03-13 10:13:34,292 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,292 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,292 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63607, dest: /127.0.0.1:60696, bytes: 98280, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 2689000
2015-03-13 10:13:34,292 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:34,293 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742214_1390{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:34,294 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:34,294 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0032
2015-03-13 10:13:34,295 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=null
2015-03-13 10:13:34,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:34,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:34,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,298 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:34,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:34,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:34,301 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:34,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:34,302 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:34,303 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:34,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:34,305 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 32 submitted by user soberoi
2015-03-13 10:13:34,305 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0032
2015-03-13 10:13:34,305 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0032
2015-03-13 10:13:34,305 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0032
2015-03-13 10:13:34,305 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from NEW to NEW_SAVING
2015-03-13 10:13:34,305 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:34,305 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,306 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:34,306 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0032 from user: soberoi activated in queue: default
2015-03-13 10:13:34,306 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0032 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:34,306 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0032 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:34,306 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0032_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:34,306 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0032 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:34,306 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:34,306 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:34,308 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0032/
2015-03-13 10:13:34,308 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] submitted hadoop job: job_1426266260362_0032
2015-03-13 10:13:34,308 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lower*upper] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0032/
2015-03-13 10:13:34,676 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742199 for deletion
2015-03-13 10:13:34,676 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:34,676 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742201 for deletion
2015-03-13 10:13:34,677 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:34,677 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742199
2015-03-13 10:13:34,677 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:34,677 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/subdir2/blk_1073742201
2015-03-13 10:13:34,677 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:34,728 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:34,728 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:34,729 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:34,729 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0032_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:34,729 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:34,729 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:34,729 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:34,730 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0032 AttemptId: appattempt_1426266260362_0032_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ]
2015-03-13 10:13:34,730 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:34,730 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,731 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:34,731 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0032_000001
2015-03-13 10:13:34,732 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,732 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0032_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:13:34,734 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:34,735 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000001 by user soberoi
2015-03-13 10:13:34,735 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:34,735 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:34,735 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:34,735 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000001 to application application_1426266260362_0032
2015-03-13 10:13:34,736 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:34,736 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] for AM appattempt_1426266260362_0032_000001
2015-03-13 10:13:34,736 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:34,736 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:34,736 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:34,736 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,736 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,736 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,737 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:34,737 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000001
2015-03-13 10:13:34,745 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0032_01_000001.tokens. Credentials list:
2015-03-13 10:13:34,759 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:34,826 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/nmPrivate/container_1426266260362_0032_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001.tokens
2015-03-13 10:13:34,826 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:34,882 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,883 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,884 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:34,890 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63613, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 518000
2015-03-13 10:13:34,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:34,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:34,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201 for deletion
2015-03-13 10:13:34,900 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:34,901 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:34,909 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:34,926 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:34,927 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:34,932 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 173000
2015-03-13 10:13:34,944 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,960 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,961 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,962 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:34,967 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63589, bytes: 1823, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 191000
2015-03-13 10:13:34,979 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:34,997 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:34,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:34,999 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:35,005 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63588, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-202646282_17113, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 264000
2015-03-13 10:13:35,019 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:35,019 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:35,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:35,047 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:35,047 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:35,112 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001/default_container_executor.sh]
2015-03-13 10:13:35,487 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:35,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:35,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:35,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:35,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:35,693 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:35,694 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:35,694 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:35,694 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:35,733 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:35,733 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:36,024 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:36,644 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:36,644 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:36,645 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380
2015-03-13 10:13:36,683 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:36,695 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:36,696 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:36,696 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:36,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:36,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:36,697 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:36,704 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED dst=null perm=null
2015-03-13 10:13:36,705 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:13:36,706 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_FAIL dst=null perm=null
2015-03-13 10:13:36,737 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:36,755 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=null
2015-03-13 10:13:36,756 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:13:36,757 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:13:36,849 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:36,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386
2015-03-13 10:13:36,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:36,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:36,850 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742206_1382
2015-03-13 10:13:36,851 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742208_1384
2015-03-13 10:13:36,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:36,898 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:37,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:37,037 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:37,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:37,101 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63615, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389, duration: 125000
2015-03-13 10:13:37,147 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742211_1387 to datanode(s) 127.0.0.1:60696
2015-03-13 10:13:37,147 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742201_1377, blk_1073742202_1378, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:37,147 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742199_1375, blk_1073742200_1376, blk_1073742202_1378, blk_1073742203_1379, blk_1073742204_1380]
2015-03-13 10:13:37,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388
2015-03-13 10:13:37,244 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742205_1381
2015-03-13 10:13:37,245 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742207_1383
2015-03-13 10:13:37,245 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742204_1380
2015-03-13 10:13:37,246 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390
2015-03-13 10:13:37,246 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385
2015-03-13 10:13:37,246 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742213_1389
2015-03-13 10:13:37,703 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 to 127.0.0.1:60696
2015-03-13 10:13:37,703 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742201_1377 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742201
2015-03-13 10:13:37,704 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:37,705 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:37,705 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:13:37,705 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:37,705 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:37,705 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63618 dest: /127.0.0.1:60696
2015-03-13 10:13:37,707 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387 src: /127.0.0.1:63618 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:13:37,708 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742211_1387 size 254067
2015-03-13 10:13:37,741 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:37,901 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:37,902 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0032_000001
2015-03-13 10:13:37,902 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0032 APPATTEMPTID=appattempt_1426266260362_0032_000001
2015-03-13 10:13:37,902 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:37,903 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from ACCEPTED to RUNNING
2015-03-13 10:13:37,920 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:37,923 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:37,982 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:38,025 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:38,098 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199 for deletion
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200 for deletion
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202 for deletion
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203 for deletion
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204 for deletion
2015-03-13 10:13:38,100 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742199_1375 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742199
2015-03-13 10:13:38,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742200_1376 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742200
2015-03-13 10:13:38,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742202_1378 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742202
2015-03-13 10:13:38,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742203_1379 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742203
2015-03-13 10:13:38,101 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742204_1380 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742204
2015-03-13 10:13:38,140 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63622 dest: /127.0.0.1:60696
2015-03-13 10:13:38,142 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63623 dest: /127.0.0.1:60689
2015-03-13 10:13:38,143 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391 src: /127.0.0.1:63624 dest: /127.0.0.1:60693
2015-03-13 10:13:38,150 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63624, dest: /127.0.0.1:60693, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 5709000
2015-03-13 10:13:38,150 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:38,151 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,151 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63623, dest: /127.0.0.1:60689, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 6608000
2015-03-13 10:13:38,151 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:38,152 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,152 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63622, dest: /127.0.0.1:60696, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 7739000
2015-03-13 10:13:38,152 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:38,153 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742215_1391{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:38,156 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:38,743 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:38,957 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,957 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:38,957 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:38,957 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,957 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:38,958 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,958 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,958 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:38,958 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:38,959 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,959 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:38,959 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,959 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,960 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:38,960 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:38,960 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,960 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:38,960 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,960 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:38,960 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:38,960 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:38,961 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0032_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:38,961 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:38,961 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,031 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:39,032 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:39,032 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:39,032 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 2 containers, <memory:3072, vCores:2> used and <memory:1024, vCores:6> available
2015-03-13 10:13:39,032 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0032 container=Container: [ContainerId: container_1426266260362_0032_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] containerId=container_1426266260362_0032_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,032 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:13:39,033 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:39,116 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0031_01_000001 succeeded
2015-03-13 10:13:39,116 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:39,116 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0031_01_000001
2015-03-13 10:13:39,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,123 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0031/container_1426266260362_0031_01_000001
2015-03-13 10:13:39,124 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0031_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:39,124 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0031_01_000001 from application application_1426266260362_0031
2015-03-13 10:13:39,124 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:39,124 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0031
2015-03-13 10:13:39,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:39,933 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,933 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,934 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:39,963 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:39,964 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:39,972 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:39,973 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:39,975 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:39,976 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:39,981 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:39,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:39,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:39,985 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:40,045 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 31 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:40,045 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0031_01_000001
2015-03-13 10:13:40,046 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0031_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:40,046 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0031_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:40,046 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0031_000001
2015-03-13 10:13:40,046 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0031 CONTAINERID=container_1426266260362_0031_01_000001
2015-03-13 10:13:40,046 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0031_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:40,046 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0031 State change from FINISHING to FINISHED
2015-03-13 10:13:40,046 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0031
2015-03-13 10:13:40,047 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0031,name=[362219F930134AB6824D0C362D17B53B/9DE4798541024E2FA2C199E3C3EC73F2] cogrouping/(1/1) ...platform/joinsintocogroup,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0031/jobhistory/job/job_1426266260362_0031,appMasterHost=Edinburgh.local,startTime=1426266790841,finishTime=1426266813074,finalStatus=SUCCEEDED
2015-03-13 10:13:40,046 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0031_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60719, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:40,047 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0031_000001
2015-03-13 10:13:40,047 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:13:40,047 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0031_01_000001, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:40,047 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:40,047 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:13:40,047 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0031_000001 released container container_1426266260362_0031_01_000001 on node: host: 10.1.1.144:60719 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:40,047 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0031_000001 is done. finalState=FINISHED
2015-03-13 10:13:40,047 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0031 requests cleared
2015-03-13 10:13:40,048 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0031 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:40,048 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0031 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:40,049 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0031_000001 (auth:SIMPLE)
2015-03-13 10:13:40,050 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0031_01_000001
2015-03-13 10:13:40,062 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:40,062 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:40,065 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000004 by user soberoi
2015-03-13 10:13:40,065 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:40,065 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:40,065 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000005 by user soberoi
2015-03-13 10:13:40,066 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000002 by user soberoi
2015-03-13 10:13:40,065 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000006 by user soberoi
2015-03-13 10:13:40,066 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0032_01_000003 by user soberoi
2015-03-13 10:13:40,066 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:40,066 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000004 to application application_1426266260362_0032
2015-03-13 10:13:40,066 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:40,066 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:40,066 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:40,066 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000005 to application application_1426266260362_0032
2015-03-13 10:13:40,067 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000002 to application application_1426266260362_0032
2015-03-13 10:13:40,067 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000003 to application application_1426266260362_0032
2015-03-13 10:13:40,068 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:40,066 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0032
2015-03-13 10:13:40,068 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:40,068 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,068 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,068 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,069 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,069 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from NEW to INITING
2015-03-13 10:13:40,069 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0032_01_000006 to application application_1426266260362_0032
2015-03-13 10:13:40,069 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,069 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from INITING to RUNNING
2015-03-13 10:13:40,069 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,069 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,069 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:40,069 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,069 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,070 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0032
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,070 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,070 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000004
2015-03-13 10:13:40,070 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:40,071 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0032
2015-03-13 10:13:40,071 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,071 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:40,071 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000006
2015-03-13 10:13:40,071 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000005
2015-03-13 10:13:40,073 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000002
2015-03-13 10:13:40,074 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0032_01_000003
2015-03-13 10:13:40,093 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000004.tokens. Credentials list:
2015-03-13 10:13:40,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0032_01_000002.tokens. Credentials list:
2015-03-13 10:13:40,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0032_01_000006.tokens. Credentials list:
2015-03-13 10:13:40,094 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0032_01_000003.tokens. Credentials list:
2015-03-13 10:13:40,095 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000005.tokens. Credentials list:
2015-03-13 10:13:40,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:40,111 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:40,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004.tokens
2015-03-13 10:13:40,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/nmPrivate/container_1426266260362_0032_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006.tokens
2015-03-13 10:13:40,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:40,198 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:40,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar dst=null perm=null
2015-03-13 10:13:40,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63632, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1021072591_17259, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 490000
2015-03-13 10:13:40,280 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63633, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340007280_17260, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387, duration: 560000
2015-03-13 10:13:40,301 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,301 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,321 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,322 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,323 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml dst=null perm=null
2015-03-13 10:13:40,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63633, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1021072591_17259, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 294000
2015-03-13 10:13:40,331 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63634, bytes: 99048, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_340007280_17260, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742214_1390, duration: 265000
2015-03-13 10:13:40,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,350 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:40,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:40,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,397 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,397 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,397 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,403 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,404 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,405 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,405 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:40,405 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,406 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:40,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006/default_container_executor.sh]
2015-03-13 10:13:40,545 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002/default_container_executor.sh]
2015-03-13 10:13:40,553 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004/default_container_executor.sh]
2015-03-13 10:13:40,554 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003/default_container_executor.sh]
2015-03-13 10:13:40,555 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005/default_container_executor.sh]
2015-03-13 10:13:40,700 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:40,748 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,749 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:40,749 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,749 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:40,749 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:40,749 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:40,750 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,750 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,750 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,951 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:13:40,964 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,964 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:40,965 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:40,965 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,965 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,965 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,965 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,966 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:40,966 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:40,966 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:40,966 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,966 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:40,965 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:40,966 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:41,046 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,046 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:41,046 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:41,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,047 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0031
2015-03-13 10:13:41,047 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0031 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:41,047 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0031, with delay of 10800 seconds
2015-03-13 10:13:41,047 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0031
2015-03-13 10:13:41,379 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0032_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005.tokens
2015-03-13 10:13:41,505 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,602 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0032_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003.tokens
2015-03-13 10:13:41,721 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,750 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,815 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:41,904 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:41,928 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0032_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002.tokens
2015-03-13 10:13:41,929 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:41,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:41,966 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,047 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,251 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391
2015-03-13 10:13:42,453 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742211_1387
2015-03-13 10:13:42,755 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,968 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:42,969 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,053 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,757 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,969 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:43,970 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,055 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,761 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:44,971 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,060 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,764 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:45,972 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,064 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,766 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,975 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,975 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:46,976 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,065 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,771 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:47,981 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,069 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,288 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:48,296 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:48,350 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:48,422 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:48,488 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63648, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 151000
2015-03-13 10:13:48,529 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63647, bytes: 1823, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 161000
2015-03-13 10:13:48,540 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63649, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 1024, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 162000
2015-03-13 10:13:48,545 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job.split dst=null perm=null
2015-03-13 10:13:48,583 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63651, bytes: 1307, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 512, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 149000
2015-03-13 10:13:48,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:48,633 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63653, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 158000
2015-03-13 10:13:48,648 INFO namenode.FSEditLog (FSEditLog.java:printStatistics(663)) - Number of transactions: 3300 Total time for transactions(ms): 140 Number of transactions batched in Syncs: 14 Number of syncs: 1881 SyncTimes(ms): 536 435
2015-03-13 10:13:48,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,649 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:48,666 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,666 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63652, bytes: 791, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742212_1388, duration: 162000
2015-03-13 10:13:48,679 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:48,682 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63649, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 147000
2015-03-13 10:13:48,701 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0/part-00004 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,702 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:48,707 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63654, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 141000
2015-03-13 10:13:48,724 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0/part-00002 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,773 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,825 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lhs-sparse.txt dst=null perm=null
2015-03-13 10:13:48,829 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63655, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 172000
2015-03-13 10:13:48,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:48,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:48,987 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,070 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,084 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,086 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,094 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,096 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,098 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,103 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63657, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 148000
2015-03-13 10:13:49,104 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63656, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 128000
2015-03-13 10:13:49,115 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63648, bytes: 87, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742209_1385, duration: 160000
2015-03-13 10:13:49,146 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,147 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001. BP-1005356445-10.1.1.144-1426266257849 blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,156 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,165 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,169 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,208 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63658 dest: /127.0.0.1:60696
2015-03-13 10:13:49,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,209 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63660 dest: /127.0.0.1:60689
2015-03-13 10:13:49,211 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392 src: /127.0.0.1:63661 dest: /127.0.0.1:60693
2015-03-13 10:13:49,212 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63659 dest: /127.0.0.1:60686
2015-03-13 10:13:49,213 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63662 dest: /127.0.0.1:60696
2015-03-13 10:13:49,215 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393 src: /127.0.0.1:63663 dest: /127.0.0.1:60689
2015-03-13 10:13:49,218 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63664, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 160000
2015-03-13 10:13:49,218 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63661, dest: /127.0.0.1:60693, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 6277000
2015-03-13 10:13:49,218 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,219 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,219 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63660, dest: /127.0.0.1:60689, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 7133000
2015-03-13 10:13:49,219 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,220 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,220 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63658, dest: /127.0.0.1:60696, bytes: 120, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 8076000
2015-03-13 10:13:49,220 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,221 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742216_1392{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,222 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63665, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 140000
2015-03-13 10:13:49,225 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63663, dest: /127.0.0.1:60689, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 8659000
2015-03-13 10:13:49,225 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,225 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0032_m_000000_0_-966470680_1
2015-03-13 10:13:49,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63662, dest: /127.0.0.1:60696, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 9321000
2015-03-13 10:13:49,226 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63659, dest: /127.0.0.1:60686, bytes: 30, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 10028000
2015-03-13 10:13:49,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,227 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742217_1393{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,231 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0/part-00001 is closed by DFSClient_attempt_1426266260362_0032_m_000001_0_2026127633_1
2015-03-13 10:13:49,236 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0 dst=null perm=null
2015-03-13 10:13:49,240 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0 dst=null perm=null
2015-03-13 10:13:49,242 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0 dst=null perm=null
2015-03-13 10:13:49,243 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000 dst=null perm=null
2015-03-13 10:13:49,246 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0/part-00004 is closed by DFSClient_attempt_1426266260362_0032_m_000004_0_-1592466482_1
2015-03-13 10:13:49,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000000_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,246 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0 dst=null perm=null
2015-03-13 10:13:49,247 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001 dst=null perm=null
2015-03-13 10:13:49,251 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000001_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0 dst=null perm=null
2015-03-13 10:13:49,270 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000003
2015-03-13 10:13:49,270 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000002
2015-03-13 10:13:49,271 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,271 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,271 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,271 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000003
2015-03-13 10:13:49,271 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,271 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,272 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,284 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000003 is : 143
2015-03-13 10:13:49,285 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,287 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63666 dest: /127.0.0.1:60686
2015-03-13 10:13:49,289 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63667 dest: /127.0.0.1:60689
2015-03-13 10:13:49,290 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394 src: /127.0.0.1:63668 dest: /127.0.0.1:60693
2015-03-13 10:13:49,295 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist for DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,297 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0 dst=null perm=null
2015-03-13 10:13:49,297 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,297 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,298 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000002
2015-03-13 10:13:49,299 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004 dst=null perm=null
2015-03-13 10:13:49,304 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000004_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,305 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0/part-00002 is closed by DFSClient_attempt_1426266260362_0032_m_000002_0_-2132934942_1
2015-03-13 10:13:49,309 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000002 is : 143
2015-03-13 10:13:49,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0 dst=null perm=null
2015-03-13 10:13:49,321 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000003
2015-03-13 10:13:49,322 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,322 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,323 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,323 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,324 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000003 from application application_1426266260362_0032
2015-03-13 10:13:49,324 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,324 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,324 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,324 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,324 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000002 from application application_1426266260362_0032
2015-03-13 10:13:49,324 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,324 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,324 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000002
2015-03-13 10:13:49,328 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,328 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000006
2015-03-13 10:13:49,328 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,330 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0 dst=null perm=null
2015-03-13 10:13:49,331 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002 dst=null perm=null
2015-03-13 10:13:49,335 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000002_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,339 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000006 is : 143
2015-03-13 10:13:49,347 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,347 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000004
2015-03-13 10:13:49,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000002
2015-03-13 10:13:49,347 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000003
2015-03-13 10:13:49,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,348 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:49,348 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,348 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,349 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000002
2015-03-13 10:13:49,349 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:13:49,349 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:49,349 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,349 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,349 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:13:49,349 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000002 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:13:49,349 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,349 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,349 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000003
2015-03-13 10:13:49,349 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:13:49,349 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:13:49,350 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,350 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,350 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,350 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:13:49,350 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000003 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:13:49,350 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,350 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:49,350 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,350 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000006 from application application_1426266260362_0032
2015-03-13 10:13:49,350 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,350 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,350 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,351 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000006
2015-03-13 10:13:49,359 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000004 is : 143
2015-03-13 10:13:49,369 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,369 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,369 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,370 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,370 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000004 from application application_1426266260362_0032
2015-03-13 10:13:49,370 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,370 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,370 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000004
2015-03-13 10:13:49,379 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,382 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/rhs-sparse.txt dst=null perm=null
2015-03-13 10:13:49,387 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63669, bytes: 52, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742210_1386, duration: 147000
2015-03-13 10:13:49,410 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003. BP-1005356445-10.1.1.144-1426266257849 blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,448 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63670 dest: /127.0.0.1:60686
2015-03-13 10:13:49,449 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63671 dest: /127.0.0.1:60696
2015-03-13 10:13:49,450 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395 src: /127.0.0.1:63672 dest: /127.0.0.1:60689
2015-03-13 10:13:49,456 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63672, dest: /127.0.0.1:60689, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 4597000
2015-03-13 10:13:49,456 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,457 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63671, dest: /127.0.0.1:60696, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 5251000
2015-03-13 10:13:49,457 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,457 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,458 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63670, dest: /127.0.0.1:60686, bytes: 8, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 6017000
2015-03-13 10:13:49,458 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,458 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742219_1395{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,463 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0/part-00003 is closed by DFSClient_attempt_1426266260362_0032_m_000003_0_-1123006855_1
2015-03-13 10:13:49,472 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0 dst=null perm=null
2015-03-13 10:13:49,478 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0 dst=null perm=null
2015-03-13 10:13:49,479 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003 dst=null perm=null
2015-03-13 10:13:49,483 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/_temporary/attempt_1426266260362_0032_m_000003_0 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:49,492 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000005
2015-03-13 10:13:49,492 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:49,492 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:13:49,492 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:49,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000004
2015-03-13 10:13:49,493 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:13:49,493 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000005
2015-03-13 10:13:49,493 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:49,493 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:13:49,493 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000004
2015-03-13 10:13:49,493 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:13:49,494 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:13:49,494 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,494 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:49,494 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:13:49,494 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000004 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:13:49,496 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,498 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1 dst=null perm=null
2015-03-13 10:13:49,505 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0032_01_000005 is : 143
2015-03-13 10:13:49,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,509 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,510 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000 dst=null perm=null
2015-03-13 10:13:49,511 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2015-03-13 10:13:49,514 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000000/part-00000 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,516 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:13:49,517 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,517 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,518 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000005
2015-03-13 10:13:49,519 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:49,519 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001 dst=null perm=null
2015-03-13 10:13:49,519 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:13:49,520 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000005 from application application_1426266260362_0032
2015-03-13 10:13:49,520 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:49,520 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:49,520 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2015-03-13 10:13:49,522 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000001/part-00001 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,523 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,524 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002 dst=null perm=null
2015-03-13 10:13:49,526 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2015-03-13 10:13:49,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000002/part-00002 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,529 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,530 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,531 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003 dst=null perm=null
2015-03-13 10:13:49,532 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2015-03-13 10:13:49,534 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000003/part-00003 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,535 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:49,536 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004 dst=null perm=null
2015-03-13 10:13:49,537 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2015-03-13 10:13:49,539 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary/1/task_1426266260362_0032_m_000004/part-00004 dst=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,544 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary dst=null perm=null
2015-03-13 10:13:49,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,549 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,551 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,553 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,564 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63668, dest: /127.0.0.1:60693, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 272669000
2015-03-13 10:13:49,564 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,565 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,566 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63667, dest: /127.0.0.1:60689, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 273543000
2015-03-13 10:13:49,566 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,567 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,567 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63666, dest: /127.0.0.1:60686, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 275284000
2015-03-13 10:13:49,567 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,568 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742218_1394{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,569 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,572 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,574 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:49,576 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63673 dest: /127.0.0.1:60693
2015-03-13 10:13:49,577 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63674 dest: /127.0.0.1:60696
2015-03-13 10:13:49,578 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396 src: /127.0.0.1:63675 dest: /127.0.0.1:60689
2015-03-13 10:13:49,581 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63675, dest: /127.0.0.1:60689, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 1158000
2015-03-13 10:13:49,581 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,582 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,582 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63674, dest: /127.0.0.1:60696, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 1846000
2015-03-13 10:13:49,582 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,582 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,583 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63673, dest: /127.0.0.1:60693, bytes: 440, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, duration: 2617000
2015-03-13 10:13:49,583 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,583 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742220_1396{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:49,585 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,588 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,594 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist dst=null perm=null
2015-03-13 10:13:49,596 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:49,600 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist dst=null perm=null
2015-03-13 10:13:49,601 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:13:49,602 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1.jhist dst=null perm=null
2015-03-13 10:13:49,605 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,608 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63676, bytes: 53372, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394, duration: 174000
2015-03-13 10:13:49,610 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,612 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63677 dest: /127.0.0.1:60686
2015-03-13 10:13:49,614 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63678 dest: /127.0.0.1:60689
2015-03-13 10:13:49,616 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397 src: /127.0.0.1:63679 dest: /127.0.0.1:60693
2015-03-13 10:13:49,622 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63679, dest: /127.0.0.1:60693, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 3765000
2015-03-13 10:13:49,623 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,624 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,623 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63678, dest: /127.0.0.1:60689, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 4374000
2015-03-13 10:13:49,624 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,626 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63677, dest: /127.0.0.1:60686, bytes: 52956, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, duration: 7035000
2015-03-13 10:13:49,626 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,626 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742221_1397{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,628 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742221_1397 size 52956
2015-03-13 10:13:49,628 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,631 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml dst=null perm=null
2015-03-13 10:13:49,632 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:49,633 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml dst=null perm=null
2015-03-13 10:13:49,634 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp dst=null perm=null
2015-03-13 10:13:49,635 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032/job_1426266260362_0032_1_conf.xml dst=null perm=null
2015-03-13 10:13:49,637 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:49,639 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63676, bytes: 91798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742215_1391, duration: 215000
2015-03-13 10:13:49,640 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:13:49,641 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63680 dest: /127.0.0.1:60696
2015-03-13 10:13:49,643 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63683 dest: /127.0.0.1:60689
2015-03-13 10:13:49,644 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398 src: /127.0.0.1:63684 dest: /127.0.0.1:60693
2015-03-13 10:13:49,647 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63684, dest: /127.0.0.1:60693, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 1778000
2015-03-13 10:13:49,647 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:49,647 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63683, dest: /127.0.0.1:60689, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 2154000
2015-03-13 10:13:49,647 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,647 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,648 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63680, dest: /127.0.0.1:60696, bytes: 91086, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1939842295_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, duration: 3239000
2015-03-13 10:13:49,648 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:49,648 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,650 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742222_1398{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:13:49,651 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1939842295_1
2015-03-13 10:13:49,652 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,654 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,655 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,656 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0032-1426266814304-soberoi-%5BDBD09B24EEFF42C28C26CEA20C707FBA%2FBEF830D517EA448A-1426266829554-5-0-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:13:49,662 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from RUNNING to FINISHING
2015-03-13 10:13:49,662 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0032
2015-03-13 10:13:49,662 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from RUNNING to REMOVING
2015-03-13 10:13:49,662 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0032
2015-03-13 10:13:49,662 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from REMOVING to FINISHING
2015-03-13 10:13:49,779 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:50,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:50,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000006
2015-03-13 10:13:50,329 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:50,329 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:13:50,329 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000006
2015-03-13 10:13:50,330 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60719, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:50,330 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:13:50,330 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000006, NodeId: 10.1.1.144:60719, NodeHttpAddress: 10.1.1.144:60722, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60719 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,331 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,331 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:13:50,331 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000006 on node: host: 10.1.1.144:60719 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:50,498 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:13:50,499 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000005
2015-03-13 10:13:50,499 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:50,499 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:13:50,499 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000005
2015-03-13 10:13:50,500 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:50,500 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:13:50,500 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,500 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:50,500 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:13:50,500 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000005 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:50,670 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742211_1387 127.0.0.1:60693 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:13:50,670 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742212_1388 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:13:50,670 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742213_1389 127.0.0.1:60689 127.0.0.1:60696 127.0.0.1:60693
2015-03-13 10:13:50,671 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742214_1390 127.0.0.1:60696 127.0.0.1:60686 127.0.0.1:60689
2015-03-13 10:13:50,671 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742218_1394 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:50,671 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742215_1391 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60693
2015-03-13 10:13:50,671 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0032 dst=null perm=null
2015-03-13 10:13:50,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,698 INFO util.Hadoop18TapUtil (Hadoop18TapUtil.java:cleanTempPath(219)) - deleting temp path /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary
2015-03-13 10:13:50,698 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/_temporary dst=null perm=null
2015-03-13 10:13:50,705 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,706 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,707 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,708 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,709 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:50,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:50,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:50,709 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:50,709 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2015-03-13 10:13:50,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:50,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:50,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:50,710 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:50,712 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 133000
2015-03-13 10:13:50,713 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2015-03-13 10:13:50,714 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 128000
2015-03-13 10:13:50,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2015-03-13 10:13:50,715 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2015-03-13 10:13:50,717 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 167000
2015-03-13 10:13:50,718 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2015-03-13 10:13:50,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,725 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,726 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,727 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,728 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 5
2015-03-13 10:13:50,729 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2015-03-13 10:13:50,730 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 139000
2015-03-13 10:13:50,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2015-03-13 10:13:50,733 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 168000
2015-03-13 10:13:50,733 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2015-03-13 10:13:50,734 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2015-03-13 10:13:50,735 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 167000
2015-03-13 10:13:50,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2015-03-13 10:13:50,736 INFO cascading.PlatformTestCase (PlatformTestCase.java:tearDown(209)) - copying to local /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output//hadoop2-mr1/joinfieldedpipesplatform/joininner
2015-03-13 10:13:50,736 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,737 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner dst=null perm=null
2015-03-13 10:13:50,738 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2015-03-13 10:13:50,739 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00000 dst=null perm=null
2015-03-13 10:13:50,740 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 124, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392, duration: 175000
2015-03-13 10:13:50,740 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2015-03-13 10:13:50,741 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00001 dst=null perm=null
2015-03-13 10:13:50,742 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 34, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393, duration: 161000
2015-03-13 10:13:50,742 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2015-03-13 10:13:50,743 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00002 dst=null perm=null
2015-03-13 10:13:50,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2015-03-13 10:13:50,744 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00003 dst=null perm=null
2015-03-13 10:13:50,745 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63688, bytes: 12, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395, duration: 138000
2015-03-13 10:13:50,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2015-03-13 10:13:50,746 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/joininner/part-00004 dst=null perm=null
2015-03-13 10:13:50,747 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:50,755 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,756 INFO util.HadoopUtil (HadoopUtil.java:findMainClass(336)) - using default application jar, may cause class not found exceptions on the cluster
2015-03-13 10:13:50,756 INFO planner.HadoopPlanner (HadoopPlanner.java:initialize(225)) - using application jar: /Users/soberoi/.gradle/caches/modules-2/files-2.1/cascading/cascading-hadoop2-mr1/2.6.3/9ae016e2b8d246b9c1de9168e715d9f1b971aa4a/cascading-hadoop2-mr1-2.6.3.jar
2015-03-13 10:13:50,775 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=null
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] source: Hfs["TextLine[['offset', 'line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt"]
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] sink: Hfs["TextLine[['line']->[ALL]]"]["/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby"]
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] parallel execution is enabled: true
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] starting jobs: 2
2015-03-13 10:13:50,777 INFO flow.Flow (BaseFlow.java:logInfo(1378)) - [lhs*rhs] allocating threads: 2
2015-03-13 10:13:50,778 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (2/2)
2015-03-13 10:13:50,784 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:50,786 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,793 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D dst=null perm=null
2015-03-13 10:13:50,794 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:50,795 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:50,797 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 33
2015-03-13 10:13:50,797 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=null
2015-03-13 10:13:50,798 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:13:50,799 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:13:50,800 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:50,801 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,802 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:13:50,803 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63690 dest: /127.0.0.1:60696
2015-03-13 10:13:50,804 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63691 dest: /127.0.0.1:60689
2015-03-13 10:13:50,805 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63692 dest: /127.0.0.1:60686
2015-03-13 10:13:50,809 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63692, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 1881000
2015-03-13 10:13:50,809 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,809 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,809 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63691, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 2424000
2015-03-13 10:13:50,809 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,810 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,810 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63690, dest: /127.0.0.1:60696, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 3332000
2015-03-13 10:13:50,810 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,811 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742223_1399{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:13:50,812 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,812 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar
2015-03-13 10:13:50,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:50,813 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,814 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:50,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:50,815 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:50,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:13:50,816 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:13:50,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:13:50,817 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:13:50,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:13:50,818 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:50,819 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:50,820 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:13:50,820 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:13:50,821 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,823 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split
2015-03-13 10:13:50,823 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:50,824 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,826 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63693 dest: /127.0.0.1:60693
2015-03-13 10:13:50,827 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63694 dest: /127.0.0.1:60686
2015-03-13 10:13:50,828 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63695 dest: /127.0.0.1:60689
2015-03-13 10:13:50,829 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400 src: /127.0.0.1:63696 dest: /127.0.0.1:60696
2015-03-13 10:13:50,831 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63696, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 1550000
2015-03-13 10:13:50,832 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,832 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,832 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63695, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 1789000
2015-03-13 10:13:50,832 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,833 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,833 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63694, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 2865000
2015-03-13 10:13:50,833 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,833 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,834 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63693, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 3263000
2015-03-13 10:13:50,834 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,834 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742224_1400{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,835 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,836 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,838 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,838 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,839 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63697 dest: /127.0.0.1:60689
2015-03-13 10:13:50,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63698 dest: /127.0.0.1:60686
2015-03-13 10:13:50,841 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401 src: /127.0.0.1:63699 dest: /127.0.0.1:60696
2015-03-13 10:13:50,844 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63699, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 1222000
2015-03-13 10:13:50,844 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,844 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,844 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63698, dest: /127.0.0.1:60686, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 1641000
2015-03-13 10:13:50,844 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,845 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,845 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63697, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 2313000
2015-03-13 10:13:50,845 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,846 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742225_1401{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,846 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,847 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:13:50,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,849 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:13:50,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:13:50,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:13:50,850 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:13:50,853 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:13:50,854 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63700 dest: /127.0.0.1:60693
2015-03-13 10:13:50,855 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63701 dest: /127.0.0.1:60686
2015-03-13 10:13:50,856 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402 src: /127.0.0.1:63702 dest: /127.0.0.1:60696
2015-03-13 10:13:50,858 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63702, dest: /127.0.0.1:60696, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 1269000
2015-03-13 10:13:50,859 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:50,859 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,859 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63701, dest: /127.0.0.1:60686, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 1688000
2015-03-13 10:13:50,859 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,860 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,860 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63700, dest: /127.0.0.1:60693, bytes: 98010, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 2518000
2015-03-13 10:13:50,860 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:50,860 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742226_1402{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:13:50,861 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:13:50,861 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0033
2015-03-13 10:13:50,862 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=null
2015-03-13 10:13:50,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:50,863 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:50,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:50,864 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:50,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:50,865 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:50,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:50,866 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:50,867 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:50,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:50,868 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:50,869 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:50,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:50,870 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:50,871 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 33 submitted by user soberoi
2015-03-13 10:13:50,871 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0033
2015-03-13 10:13:50,871 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0033
2015-03-13 10:13:50,871 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0033
2015-03-13 10:13:50,871 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from NEW to NEW_SAVING
2015-03-13 10:13:50,872 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:13:50,872 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0033_000001
2015-03-13 10:13:50,872 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from NEW to SUBMITTED
2015-03-13 10:13:50,872 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0033 from user: soberoi activated in queue: default
2015-03-13 10:13:50,872 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0033 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:13:50,872 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0033 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:13:50,872 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0033 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:13:50,873 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0033_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:13:50,873 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:13:50,874 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from SUBMITTED to ACCEPTED
2015-03-13 10:13:50,875 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0033/
2015-03-13 10:13:50,875 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0033
2015-03-13 10:13:50,875 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0033/
2015-03-13 10:13:51,259 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:51,259 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:13:51,259 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available
2015-03-13 10:13:51,259 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0033_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:51,259 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:13:51,259 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:51,260 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:51,260 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0033 AttemptId: appattempt_1426266260362_0033_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:13:51,261 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:13:51,261 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,261 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:13:51,261 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0033_000001
2015-03-13 10:13:51,262 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,262 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0033_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:13:51,264 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:51,265 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000001 by user soberoi
2015-03-13 10:13:51,265 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:51,265 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:13:51,265 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:51,266 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000001 to application application_1426266260362_0033
2015-03-13 10:13:51,266 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:51,266 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0033_000001
2015-03-13 10:13:51,266 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:13:51,266 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:13:51,266 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:51,266 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,266 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,266 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,267 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:51,267 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000001
2015-03-13 10:13:51,276 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0033_01_000001.tokens. Credentials list:
2015-03-13 10:13:51,290 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:51,359 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0033_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001.tokens
2015-03-13 10:13:51,359 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:51,418 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:51,419 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:51,420 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:51,425 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 327000
2015-03-13 10:13:51,443 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:51,458 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:51,459 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:51,464 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63687, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 173000
2015-03-13 10:13:51,476 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,492 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:51,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:51,493 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:13:51,499 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 178000
2015-03-13 10:13:51,511 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:51,527 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:51,528 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:51,533 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63686, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1742906083_17658, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 292000
2015-03-13 10:13:51,545 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:51,546 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:51,570 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:51,570 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:51,634 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001/default_container_executor.sh]
2015-03-13 10:13:51,787 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:51,865 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:51,866 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:51,866 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:51,866 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:51,867 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:51,867 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:51,912 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:51,912 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:51,913 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:51,913 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742218_1394
2015-03-13 10:13:51,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:51,914 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:52,117 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742221_1397
2015-03-13 10:13:52,165 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60696 to replicate blk_1073742223_1399 to datanode(s) 127.0.0.1:60693
2015-03-13 10:13:52,165 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742215_1391]
2015-03-13 10:13:52,165 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742214_1390, blk_1073742215_1391, blk_1073742218_1394]
2015-03-13 10:13:52,262 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:52,262 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:52,267 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:52,268 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:52,464 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742217_1393
2015-03-13 10:13:52,465 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:52,466 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:52,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742222_1398
2015-03-13 10:13:52,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742216_1392
2015-03-13 10:13:52,467 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742219_1395
2015-03-13 10:13:52,468 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742220_1396
2015-03-13 10:13:52,468 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:52,667 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:52,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:52,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:52,696 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:52,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:52,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:52,697 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:52,793 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:53,117 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-318492837-10.1.1.144-60696-1426266259571, infoPort=60697, ipcPort=60698, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 to 127.0.0.1:60693
2015-03-13 10:13:53,117 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:53,117 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:53,117 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:53,117 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:53,118 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:53,118 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:53,117 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:53,118 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:53,118 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:53,119 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:53,118 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 (numBytes=254067) to /127.0.0.1:60693
2015-03-13 10:13:53,119 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63706 dest: /127.0.0.1:60693
2015-03-13 10:13:53,120 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399 src: /127.0.0.1:63706 dest: /127.0.0.1:60693 of size 254067
2015-03-13 10:13:53,121 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742223_1399 size 254067
2015-03-13 10:13:53,200 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:13:53,221 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED dst=null perm=null
2015-03-13 10:13:53,222 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:13:53,223 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_FAIL dst=null perm=null
2015-03-13 10:13:53,266 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:53,275 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=null
2015-03-13 10:13:53,276 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:13:53,277 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:13:53,557 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:53,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.splitmetainfo dst=null perm=null
2015-03-13 10:13:53,619 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63708, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401, duration: 189000
2015-03-13 10:13:53,795 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:54,266 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:54,374 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:54,375 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0033_000001
2015-03-13 10:13:54,375 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0033 APPATTEMPTID=appattempt_1426266260362_0033_000001
2015-03-13 10:13:54,376 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:13:54,376 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from ACCEPTED to RUNNING
2015-03-13 10:13:54,396 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:54,398 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:13:54,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:13:54,586 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:13:54,625 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63714 dest: /127.0.0.1:60686
2015-03-13 10:13:54,729 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63715 dest: /127.0.0.1:60696
2015-03-13 10:13:54,731 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403 src: /127.0.0.1:63716 dest: /127.0.0.1:60689
2015-03-13 10:13:54,737 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63716, dest: /127.0.0.1:60689, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 4657000
2015-03-13 10:13:54,737 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:13:54,737 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,737 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63715, dest: /127.0.0.1:60696, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 5199000
2015-03-13 10:13:54,738 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:54,738 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63714, dest: /127.0.0.1:60686, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 6015000
2015-03-13 10:13:54,738 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,738 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:13:54,739 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742227_1403{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:13:54,742 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:13:54,801 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:55,166 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742213_1389, blk_1073742215_1391, blk_1073742218_1394]
2015-03-13 10:13:55,166 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742211_1387, blk_1073742212_1388, blk_1073742214_1390, blk_1073742218_1394]
2015-03-13 10:13:55,268 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:55,516 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,516 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:13:55,516 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:55,516 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,517 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:13:55,517 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,517 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:13:55,517 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:13:55,518 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,518 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:13:55,518 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,519 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:13:55,519 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:13:55,519 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,519 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:13:55,519 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,519 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,520 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:13:55,520 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:13:55,520 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0033_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,520 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:13:55,520 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,701 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0032_01_000001 succeeded
2015-03-13 10:13:55,701 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:13:55,701 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0032_01_000001
2015-03-13 10:13:55,709 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,709 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0032/container_1426266260362_0032_01_000001
2015-03-13 10:13:55,710 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0032_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:13:55,710 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0032_01_000001 from application application_1426266260362_0032
2015-03-13 10:13:55,710 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:55,710 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0032
2015-03-13 10:13:55,717 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:55,718 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214 for deletion
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742214_1390 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742214
2015-03-13 10:13:55,719 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:55,801 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 32 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:13:55,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0032_01_000001
2015-03-13 10:13:55,802 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0032_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:13:55,802 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0032_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:13:55,802 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0032_000001
2015-03-13 10:13:55,802 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0032 CONTAINERID=container_1426266260362_0032_01_000001
2015-03-13 10:13:55,803 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0032_000001 State change from FINISHING to FINISHED
2015-03-13 10:13:55,803 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0032_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:13:55,803 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0032 State change from FINISHING to FINISHED
2015-03-13 10:13:55,803 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:13:55,803 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0032_000001
2015-03-13 10:13:55,803 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0032
2015-03-13 10:13:55,803 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0032,name=[DBD09B24EEFF42C28C26CEA20C707FBA/BEF830D517EA448A98DAE15B6614864B] lower*upper/(1/1) ...edpipesplatform/joininner,user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0032/jobhistory/job/job_1426266260362_0032,appMasterHost=Edinburgh.local,startTime=1426266814304,finishTime=1426266829662,finalStatus=SUCCEEDED
2015-03-13 10:13:55,803 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0032_01_000001, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,804 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,804 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5
2015-03-13 10:13:55,804 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0032_000001 released container container_1426266260362_0032_01_000001 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:13:55,804 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:13:55,804 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:13:55,804 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:13:55,804 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0033_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,805 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:13:55,805 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:13:55,805 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0032_000001 is done. finalState=FINISHED
2015-03-13 10:13:55,805 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0032 requests cleared
2015-03-13 10:13:55,805 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0032 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:13:55,805 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0032 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:13:55,806 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0032_000001 (auth:SIMPLE)
2015-03-13 10:13:55,806 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0032_01_000001
2015-03-13 10:13:55,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:55,923 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400
2015-03-13 10:13:55,924 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742225_1401
2015-03-13 10:13:55,924 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211 for deletion
2015-03-13 10:13:55,924 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212 for deletion
2015-03-13 10:13:55,924 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213 for deletion
2015-03-13 10:13:55,924 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215 for deletion
2015-03-13 10:13:55,925 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218 for deletion
2015-03-13 10:13:55,925 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742212_1388 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742212
2015-03-13 10:13:55,924 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742211_1387 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742211
2015-03-13 10:13:55,925 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742215_1391 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742215
2015-03-13 10:13:55,925 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742213_1389 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742213
2015-03-13 10:13:55,926 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742218_1394 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742218
2015-03-13 10:13:56,274 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:56,340 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,340 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,340 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,340 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,340 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,341 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-2_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,413 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,413 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,414 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:13:56,442 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,443 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,452 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,453 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,455 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:56,456 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:56,461 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:56,463 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:56,464 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:13:56,465 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:13:56,520 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,520 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,520 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,521 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,521 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,521 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,521 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,522 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,542 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:56,542 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:13:56,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000005 by user soberoi
2015-03-13 10:13:56,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000002 by user soberoi
2015-03-13 10:13:56,545 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:56,545 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:13:56,546 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000002 to application application_1426266260362_0033
2015-03-13 10:13:56,545 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:13:56,546 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:56,546 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000005 to application application_1426266260362_0033
2015-03-13 10:13:56,546 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:56,546 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,546 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,547 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,547 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,547 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,547 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,547 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,547 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000005
2015-03-13 10:13:56,548 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000002
2015-03-13 10:13:56,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000003 by user soberoi
2015-03-13 10:13:56,548 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:13:56,548 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000006 by user soberoi
2015-03-13 10:13:56,549 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0033
2015-03-13 10:13:56,549 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:13:56,550 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000003 to application application_1426266260362_0033
2015-03-13 10:13:56,550 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,550 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,550 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,550 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,550 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from NEW to INITING
2015-03-13 10:13:56,550 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000006 to application application_1426266260362_0033
2015-03-13 10:13:56,550 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from INITING to RUNNING
2015-03-13 10:13:56,551 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,551 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,551 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,551 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,551 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,551 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,551 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:13:56,551 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000006
2015-03-13 10:13:56,550 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000004 by user soberoi
2015-03-13 10:13:56,552 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:13:56,550 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,553 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000004 to application application_1426266260362_0033
2015-03-13 10:13:56,553 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000003
2015-03-13 10:13:56,554 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:13:56,554 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,554 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:13:56,554 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:13:56,555 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:13:56,555 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0033_01_000004
2015-03-13 10:13:56,575 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0033_01_000005.tokens. Credentials list:
2015-03-13 10:13:56,575 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000002.tokens. Credentials list:
2015-03-13 10:13:56,575 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0033_01_000006.tokens. Credentials list:
2015-03-13 10:13:56,576 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0033_01_000003.tokens. Credentials list:
2015-03-13 10:13:56,576 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000004.tokens. Credentials list:
2015-03-13 10:13:56,593 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:56,594 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:56,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0033_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006.tokens
2015-03-13 10:13:56,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/nmPrivate/container_1426266260362_0033_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005.tokens
2015-03-13 10:13:56,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:56,669 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:56,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,731 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,732 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar dst=null perm=null
2015-03-13 10:13:56,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63725, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1160147824_17804, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 409000
2015-03-13 10:13:56,739 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63724, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1236516046_17803, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399, duration: 504000
2015-03-13 10:13:56,759 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,760 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,779 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,780 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml dst=null perm=null
2015-03-13 10:13:56,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63726, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_1160147824_17804, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 309000
2015-03-13 10:13:56,787 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63727, bytes: 98778, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1236516046_17803, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742226_1402, duration: 312000
2015-03-13 10:13:56,801 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,801 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,801 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,801 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:13:56,802 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:13:56,802 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:56,802 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:13:56,803 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:56,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,803 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0032
2015-03-13 10:13:56,803 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0032 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:13:56,803 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0032, with delay of 10800 seconds
2015-03-13 10:13:56,803 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,804 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0032
2015-03-13 10:13:56,860 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,860 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,863 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,863 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,864 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,864 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,865 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,865 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:56,866 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:13:56,866 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:13:57,004 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005/default_container_executor.sh]
2015-03-13 10:13:57,011 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006/default_container_executor.sh]
2015-03-13 10:13:57,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004/default_container_executor.sh]
2015-03-13 10:13:57,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002/default_container_executor.sh]
2015-03-13 10:13:57,034 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003/default_container_executor.sh]
2015-03-13 10:13:57,126 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742223_1399
2015-03-13 10:13:57,273 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:57,275 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,427 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:13:57,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,525 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,526 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,526 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:13:57,671 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403
2015-03-13 10:13:57,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:57,837 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:57,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004.tokens
2015-03-13 10:13:57,950 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,074 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:58,207 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/nmPrivate/container_1426266260362_0033_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003.tokens
2015-03-13 10:13:58,207 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,278 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,307 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:13:58,436 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/nmPrivate/container_1426266260362_0033_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002.tokens
2015-03-13 10:13:58,437 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:13:58,529 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,529 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:58,806 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,279 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,530 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,531 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:13:59,812 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,284 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,535 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:00,815 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,289 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,538 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:01,816 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,292 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,541 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:02,820 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,293 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,546 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,547 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:03,825 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,298 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,551 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,552 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:04,831 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,175 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:14:05,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:14:05,274 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:14:05,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:14:05,302 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,317 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job.split dst=null perm=null
2015-03-13 10:14:05,349 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63740, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000001_0_976062286_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 155000
2015-03-13 10:14:05,435 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63742, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000004_0_-1416122943_1, offset: 1024, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 150000
2015-03-13 10:14:05,438 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63743, bytes: 766, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000003_0_1689206587_1, offset: 1024, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 154000
2015-03-13 10:14:05,471 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63745, bytes: 1282, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000002_0_-2116056898_1, offset: 512, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 149000
2015-03-13 10:14:05,471 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63744, bytes: 1798, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000000_0_884156281_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742224_1400, duration: 118000
2015-03-13 10:14:05,502 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:05,505 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63746, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000001_0_976062286_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 161000
2015-03-13 10:14:05,550 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:05,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63747, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000004_0_-1416122943_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 180000
2015-03-13 10:14:05,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,554 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,556 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:05,562 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63748, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000003_0_1689206587_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 143000
2015-03-13 10:14:05,583 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:05,587 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60693, dest: /127.0.0.1:63749, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000002_0_-2116056898_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 168000
2015-03-13 10:14:05,591 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:05,832 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:05,989 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000001_0 dst=null perm=null
2015-03-13 10:14:06,017 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,017 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000003
2015-03-13 10:14:06,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,018 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,030 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000003 is : 143
2015-03-13 10:14:06,032 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist. BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:06,034 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63750 dest: /127.0.0.1:60686
2015-03-13 10:14:06,035 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63751 dest: /127.0.0.1:60693
2015-03-13 10:14:06,037 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404 src: /127.0.0.1:63752 dest: /127.0.0.1:60689
2015-03-13 10:14:06,041 INFO hdfs.StateChange (FSNamesystem.java:fsync(3456)) - BLOCK* fsync: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist for DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:06,042 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000003 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,042 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,043 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000003
2015-03-13 10:14:06,042 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000003 from application application_1426266260362_0033
2015-03-13 10:14:06,043 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,043 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,075 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000004_0 dst=null perm=null
2015-03-13 10:14:06,091 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000006
2015-03-13 10:14:06,091 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:06,091 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,091 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000006
2015-03-13 10:14:06,092 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,102 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63744, bytes: 23, op: HDFS_READ, cliID: DFSClient_attempt_1426266260362_0033_m_000000_0_884156281_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073741841_1017, duration: 140000
2015-03-13 10:14:06,104 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000006 is : 143
2015-03-13 10:14:06,105 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000003_0 dst=null perm=null
2015-03-13 10:14:06,116 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,116 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:06,117 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000006 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,117 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000006 from application application_1426266260362_0033
2015-03-13 10:14:06,117 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,118 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,129 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,129 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000005
2015-03-13 10:14:06,129 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:06,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000003
2015-03-13 10:14:06,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,130 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,130 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000003 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:06,130 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000003 in state: COMPLETED event:FINISHED
2015-03-13 10:14:06,130 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000003
2015-03-13 10:14:06,131 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available, release resources=true
2015-03-13 10:14:06,131 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:6144, vCores:5> numContainers=5 user=soberoi user-resources=<memory:6144, vCores:5>
2015-03-13 10:14:06,131 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000003, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,131 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,131 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:5>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=1, numContainers=5
2015-03-13 10:14:06,131 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000003 on node: host: 10.1.1.144:60715 #containers=3 available=1024 used=3072 with event: FINISHED
2015-03-13 10:14:06,143 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000005 is : 143
2015-03-13 10:14:06,154 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000000_0 dst=null perm=null
2015-03-13 10:14:06,155 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,155 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,155 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,156 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000005
2015-03-13 10:14:06,157 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,157 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000005 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,157 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000005 from application application_1426266260362_0033
2015-03-13 10:14:06,158 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,158 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,160 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_m_000002_0 dst=null perm=null
2015-03-13 10:14:06,172 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000002
2015-03-13 10:14:06,172 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:06,172 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,173 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,173 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,173 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000002
2015-03-13 10:14:06,173 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:06,173 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000005
2015-03-13 10:14:06,174 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000005 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:06,174 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000005 in state: COMPLETED event:FINISHED
2015-03-13 10:14:06,174 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000005
2015-03-13 10:14:06,174 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available, release resources=true
2015-03-13 10:14:06,174 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:5120, vCores:4> numContainers=4 user=soberoi user-resources=<memory:5120, vCores:4>
2015-03-13 10:14:06,174 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000005, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,174 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:06,174 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:4>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=1, numContainers=4
2015-03-13 10:14:06,174 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000005 on node: host: 10.1.1.144:60715 #containers=2 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:06,176 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000004
2015-03-13 10:14:06,176 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:06,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:06,177 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:06,186 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000002 is : 143
2015-03-13 10:14:06,200 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from RUNNING to KILLING
2015-03-13 10:14:06,200 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,200 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000004
2015-03-13 10:14:06,207 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000004 is : 143
2015-03-13 10:14:06,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,214 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:06,215 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:06,215 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000002 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,215 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,216 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,217 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000004
2015-03-13 10:14:06,217 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000002 from application application_1426266260362_0033
2015-03-13 10:14:06,217 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,217 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,218 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:06,218 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000004 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:06,218 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000004 from application application_1426266260362_0033
2015-03-13 10:14:06,218 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:06,218 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:06,307 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:07,095 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,095 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000006
2015-03-13 10:14:07,096 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000006 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,096 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000006 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,096 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000006
2015-03-13 10:14:07,096 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:07,096 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:4096, vCores:3> numContainers=3 user=soberoi user-resources=<memory:4096, vCores:3>
2015-03-13 10:14:07,096 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000006, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,096 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,097 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:3>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=1, numContainers=3
2015-03-13 10:14:07,097 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000006 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:07,180 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,180 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000002
2015-03-13 10:14:07,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:07,181 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000004
2015-03-13 10:14:07,181 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000002 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,182 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000002 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,182 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000002
2015-03-13 10:14:07,182 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available, release resources=true
2015-03-13 10:14:07,182 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:3072, vCores:2> numContainers=2 user=soberoi user-resources=<memory:3072, vCores:2>
2015-03-13 10:14:07,182 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000002, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2 usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,182 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,183 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:07,183 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000002 on node: host: 10.1.1.144:60715 #containers=1 available=3072 used=1024 with event: FINISHED
2015-03-13 10:14:07,183 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000004 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:07,183 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000004 in state: COMPLETED event:FINISHED
2015-03-13 10:14:07,183 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000004
2015-03-13 10:14:07,183 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:07,183 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:07,183 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000004, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,184 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:07,184 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:07,184 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000004 on node: host: 10.1.1.144:60715 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:07,311 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:08,101 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:08,101 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:08,102 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:08,102 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0033 container=Container: [ContainerId: container_1426266260362_0033_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0033_01_000007 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:08,102 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:3072, vCores:2>usedCapacity=0.1875, absoluteUsedCapacity=0.1875, numApps=1, numContainers=2
2015-03-13 10:14:08,102 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.1875 absoluteUsedCapacity=0.1875 used=<memory:3072, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:08,314 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:08,475 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:08,483 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0033_01_000007 by user soberoi
2015-03-13 10:14:08,483 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:08,483 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0033_01_000007 to application application_1426266260362_0033
2015-03-13 10:14:08,484 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from NEW to LOCALIZING
2015-03-13 10:14:08,484 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0033
2015-03-13 10:14:08,484 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0033
2015-03-13 10:14:08,484 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:08,484 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0033
2015-03-13 10:14:08,485 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:08,510 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:08,510 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:08,573 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007/default_container_executor.sh]
2015-03-13 10:14:09,102 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:09,103 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:09,320 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:09,481 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:14:10,104 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:10,325 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:10,855 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000 dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:10,895 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000. BP-1005356445-10.1.1.144-1426266257849 blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:10,952 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63760 dest: /127.0.0.1:60686
2015-03-13 10:14:10,953 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63763 dest: /127.0.0.1:60693
2015-03-13 10:14:10,954 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405 src: /127.0.0.1:63764 dest: /127.0.0.1:60689
2015-03-13 10:14:10,963 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63764, dest: /127.0.0.1:60689, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 8365000
2015-03-13 10:14:10,963 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:10,964 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,964 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63763, dest: /127.0.0.1:60693, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 8676000
2015-03-13 10:14:10,964 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:10,964 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,965 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63760, dest: /127.0.0.1:60686, bytes: 180, op: HDFS_WRITE, cliID: DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, duration: 9417000
2015-03-13 10:14:10,965 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:10,965 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742229_1405{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:10,968 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0/part-00000 is closed by DFSClient_attempt_1426266260362_0033_r_000000_0_-21688833_1
2015-03-13 10:14:10,977 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0 dst=null perm=null
2015-03-13 10:14:10,983 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0 dst=null perm=null
2015-03-13 10:14:10,984 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000 dst=null perm=null
2015-03-13 10:14:10,986 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/_temporary/attempt_1426266260362_0033_r_000000_0 dst=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000 perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:10,993 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000007
2015-03-13 10:14:10,993 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from RUNNING to KILLING
2015-03-13 10:14:10,993 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Stop Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:10,993 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000007
2015-03-13 10:14:10,994 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_RUNNING diagnostics: "Container killed by the ApplicationMaster.\n" exit_status: -1000
2015-03-13 10:14:10,998 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,000 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_STARTED is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,003 WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(207)) - Exit code from container container_1426266260362_0033_01_000007 is : 143
2015-03-13 10:14:11,004 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1 dst=null perm=null
2015-03-13 10:14:11,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D dst=null perm=null
2015-03-13 10:14:11,008 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D dst=null perm=null
2015-03-13 10:14:11,009 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=listStatus src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000 dst=null perm=null
2015-03-13 10:14:11,010 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000 dst=null perm=null
2015-03-13 10:14:11,011 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from KILLING to CONTAINER_CLEANEDUP_AFTER_KILL
2015-03-13 10:14:11,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,012 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Killed TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:11,013 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000007 transitioned from CONTAINER_CLEANEDUP_AFTER_KILL to DONE
2015-03-13 10:14:11,013 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000007 from application application_1426266260362_0033
2015-03-13 10:14:11,013 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:11,013 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:11,014 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary/1/task_1426266260362_0033_r_000000/part-00000 dst=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/part-00000 perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,018 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_temporary dst=null perm=null
2015-03-13 10:14:11,021 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,022 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-soberoi/1072129387_rhs_B285445D85F74CE593BADDE588159D8D/_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,024 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,025 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/COMMIT_SUCCESS is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,038 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63752, dest: /127.0.0.1:60689, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 4999470000
2015-03-13 10:14:11,038 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,039 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,039 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63751, dest: /127.0.0.1:60693, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 5000560000
2015-03-13 10:14:11,039 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,040 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63750, dest: /127.0.0.1:60686, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 5001744000
2015-03-13 10:14:11,040 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,040 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742228_1404{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:11,042 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,043 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,045 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:11,046 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63765 dest: /127.0.0.1:60686
2015-03-13 10:14:11,048 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63766 dest: /127.0.0.1:60689
2015-03-13 10:14:11,049 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406 src: /127.0.0.1:63767 dest: /127.0.0.1:60696
2015-03-13 10:14:11,052 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63767, dest: /127.0.0.1:60696, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 1192000
2015-03-13 10:14:11,052 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,052 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,052 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63766, dest: /127.0.0.1:60689, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 1616000
2015-03-13 10:14:11,052 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,053 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63765, dest: /127.0.0.1:60686, bytes: 422, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, duration: 2289000
2015-03-13 10:14:11,053 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,053 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742230_1406{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,054 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,057 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,061 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist dst=null perm=null
2015-03-13 10:14:11,062 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:14:11,065 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist dst=null perm=null
2015-03-13 10:14:11,066 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=null
2015-03-13 10:14:11,067 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1.jhist dst=null perm=null
2015-03-13 10:14:11,069 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,074 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63768, bytes: 67415, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404, duration: 225000
2015-03-13 10:14:11,076 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:11,077 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63769 dest: /127.0.0.1:60686
2015-03-13 10:14:11,078 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63770 dest: /127.0.0.1:60689
2015-03-13 10:14:11,079 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407 src: /127.0.0.1:63771 dest: /127.0.0.1:60696
2015-03-13 10:14:11,082 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63771, dest: /127.0.0.1:60696, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 1681000
2015-03-13 10:14:11,082 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,083 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63770, dest: /127.0.0.1:60689, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 2322000
2015-03-13 10:14:11,083 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,083 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,084 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63769, dest: /127.0.0.1:60686, bytes: 66891, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, duration: 3100000
2015-03-13 10:14:11,084 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,084 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742231_1407{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:11,085 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,087 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,088 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml dst=null perm=null
2015-03-13 10:14:11,089 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp dst=null perm=null
2015-03-13 10:14:11,090 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml dst=null perm=null
2015-03-13 10:14:11,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp dst=null perm=null
2015-03-13 10:14:11,091 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033/job_1426266260362_0033_1_conf.xml dst=null perm=null
2015-03-13 10:14:11,093 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:11,095 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63772, bytes: 91440, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742227_1403, duration: 267000
2015-03-13 10:14:11,097 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp. BP-1005356445-10.1.1.144-1426266257849 blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]}
2015-03-13 10:14:11,098 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63773 dest: /127.0.0.1:60696
2015-03-13 10:14:11,099 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63774 dest: /127.0.0.1:60686
2015-03-13 10:14:11,101 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408 src: /127.0.0.1:63775 dest: /127.0.0.1:60693
2015-03-13 10:14:11,103 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63775, dest: /127.0.0.1:60693, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 1754000
2015-03-13 10:14:11,103 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:11,104 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,104 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63774, dest: /127.0.0.1:60686, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 2253000
2015-03-13 10:14:11,104 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,105 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63773, dest: /127.0.0.1:60696, bytes: 90728, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_-1509750256_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, duration: 2922000
2015-03-13 10:14:11,105 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:11,105 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742232_1408{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW]]} size 0
2015-03-13 10:14:11,107 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp is closed by DFSClient_NONMAPREDUCE_-1509750256_1
2015-03-13 10:14:11,108 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp dst=null perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,109 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033.summary perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,111 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033_conf.xml perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,113 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=rename src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist_tmp dst=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi/job_1426266260362_0033-1426266830871-soberoi-%5B2C202E1F11CB4F72A241D80B1FC5F547%2F2FBAD5263615431A-1426266851026-5-1-SUCCEEDED-default.jhist perm=soberoi:supergroup:rwxrwx---
2015-03-13 10:14:11,119 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from RUNNING to FINISHING
2015-03-13 10:14:11,119 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(686)) - Removing application with id application_1426266260362_0033
2015-03-13 10:14:11,119 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from RUNNING to REMOVING
2015-03-13 10:14:11,119 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(487)) - Removing info for app: application_1426266260362_0033
2015-03-13 10:14:11,120 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from REMOVING to FINISHING
2015-03-13 10:14:11,329 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:11,994 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 7 } state: C_COMPLETE diagnostics: "Container killed by the ApplicationMaster.\nContainer killed on request. Exit code is 143\n" exit_status: 143
2015-03-13 10:14:11,994 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000007
2015-03-13 10:14:11,995 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000007 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:11,995 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000007 in state: COMPLETED event:FINISHED
2015-03-13 10:14:11,995 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000007
2015-03-13 10:14:11,995 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000007 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 0 containers, <memory:0, vCores:0> used and <memory:4096, vCores:8> available, release resources=true
2015-03-13 10:14:11,996 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:2048, vCores:1> numContainers=1 user=soberoi user-resources=<memory:2048, vCores:1>
2015-03-13 10:14:11,996 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000007, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 10, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] resource=<memory:1024, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:11,996 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:11,996 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=1, numContainers=1
2015-03-13 10:14:11,996 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000007 on node: host: 10.1.1.144:60711 #containers=0 available=4096 used=0 with event: FINISHED
2015-03-13 10:14:12,131 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742223_1399 127.0.0.1:60696 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60693
2015-03-13 10:14:12,131 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742224_1400 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60689 127.0.0.1:60696
2015-03-13 10:14:12,131 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742225_1401 127.0.0.1:60689 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:14:12,131 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742226_1402 127.0.0.1:60693 127.0.0.1:60686 127.0.0.1:60696
2015-03-13 10:14:12,132 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742228_1404 127.0.0.1:60686 127.0.0.1:60693 127.0.0.1:60689
2015-03-13 10:14:12,132 INFO BlockStateChange (BlockManager.java:addToInvalidates(1009)) - BLOCK* addToInvalidates: blk_1073742227_1403 127.0.0.1:60686 127.0.0.1:60696 127.0.0.1:60689
2015-03-13 10:14:12,132 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=delete src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0033 dst=null perm=null
2015-03-13 10:14:12,142 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404
2015-03-13 10:14:12,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,143 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:12,165 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] starting step: (1/2) ...orm/samepipearoundgroupby
2015-03-13 10:14:12,173 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,182 INFO client.RMProxy (RMProxy.java:createRMProxy(56)) - Connecting to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,185 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby dst=null perm=null
2015-03-13 10:14:12,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:14:12,186 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:14:12,188 INFO resourcemanager.ClientRMService (ClientRMService.java:getNewApplicationId(209)) - Allocated new applicationId: 34
2015-03-13 10:14:12,189 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034 dst=null perm=null
2015-03-13 10:14:12,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034 dst=null perm=soberoi:supergroup:rwxr-xr-x
2015-03-13 10:14:12,190 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034 dst=null perm=soberoi:supergroup:rwx------
2015-03-13 10:14:12,191 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,192 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,194 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar. BP-1005356445-10.1.1.144-1426266257849 blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:12,195 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63778 dest: /127.0.0.1:60689
2015-03-13 10:14:12,196 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63779 dest: /127.0.0.1:60693
2015-03-13 10:14:12,197 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63780 dest: /127.0.0.1:60686
2015-03-13 10:14:12,201 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63780, dest: /127.0.0.1:60686, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 2769000
2015-03-13 10:14:12,201 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,201 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,202 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63779, dest: /127.0.0.1:60693, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 2619000
2015-03-13 10:14:12,202 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,202 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,202 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63778, dest: /127.0.0.1:60689, bytes: 254067, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 3560000
2015-03-13 10:14:12,202 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,203 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742233_1409{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,204 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,204 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar
2015-03-13 10:14:12,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,205 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,206 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:12,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:12,207 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:12,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir dst=null perm=null
2015-03-13 10:14:12,208 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target dst=null perm=null
2015-03-13 10:14:12,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi dst=null perm=null
2015-03-13 10:14:12,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user dst=null perm=null
2015-03-13 10:14:12,209 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/ dst=null perm=null
2015-03-13 10:14:12,210 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:12,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:12,212 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(253)) - Total input paths to process : 1
2015-03-13 10:14:12,212 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/classes/test/data/lower.txt dst=null perm=null
2015-03-13 10:14:12,214 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,215 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,216 INFO blockmanagement.BlockManager (BlockManager.java:setReplication(2391)) - Increasing replication from 3 to 10 for /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split
2015-03-13 10:14:12,216 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setReplication src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,217 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split. BP-1005356445-10.1.1.144-1426266257849 blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:12,219 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63781 dest: /127.0.0.1:60696
2015-03-13 10:14:12,220 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63782 dest: /127.0.0.1:60693
2015-03-13 10:14:12,221 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63783 dest: /127.0.0.1:60689
2015-03-13 10:14:12,223 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410 src: /127.0.0.1:63784 dest: /127.0.0.1:60686
2015-03-13 10:14:12,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63784, dest: /127.0.0.1:60686, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 1395000
2015-03-13 10:14:12,226 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,226 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,226 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63783, dest: /127.0.0.1:60689, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 1699000
2015-03-13 10:14:12,227 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,227 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,227 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63782, dest: /127.0.0.1:60693, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 2676000
2015-03-13 10:14:12,227 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,228 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,228 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63781, dest: /127.0.0.1:60696, bytes: 1782, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 3417000
2015-03-13 10:14:12,228 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,229 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742234_1410{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:12,230 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,231 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,232 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,233 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo. BP-1005356445-10.1.1.144-1426266257849 blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]}
2015-03-13 10:14:12,235 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63785 dest: /127.0.0.1:60693
2015-03-13 10:14:12,236 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63786 dest: /127.0.0.1:60689
2015-03-13 10:14:12,237 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411 src: /127.0.0.1:63787 dest: /127.0.0.1:60696
2015-03-13 10:14:12,239 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63787, dest: /127.0.0.1:60696, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1119000
2015-03-13 10:14:12,239 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,240 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63786, dest: /127.0.0.1:60689, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1286000
2015-03-13 10:14:12,240 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,240 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,241 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63785, dest: /127.0.0.1:60693, bytes: 183, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 1953000
2015-03-13 10:14:12,241 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,242 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742235_1411{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW]]} size 0
2015-03-13 10:14:12,243 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,243 INFO mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(394)) - number of splits:5
2015-03-13 10:14:12,244 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,245 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=setPermission src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=soberoi:supergroup:rw-r--r--
2015-03-13 10:14:12,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - fs.default.name is deprecated. Instead, use fs.defaultFS
2015-03-13 10:14:12,246 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - mapreduce.job.counters.limit is deprecated. Instead, use mapreduce.job.counters.max
2015-03-13 10:14:12,247 INFO Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(840)) - io.bytes.per.checksum is deprecated. Instead, use dfs.bytes-per-checksum
2015-03-13 10:14:12,250 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]}
2015-03-13 10:14:12,251 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63788 dest: /127.0.0.1:60693
2015-03-13 10:14:12,252 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63789 dest: /127.0.0.1:60696
2015-03-13 10:14:12,253 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412 src: /127.0.0.1:63790 dest: /127.0.0.1:60689
2015-03-13 10:14:12,256 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63790, dest: /127.0.0.1:60689, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 1607000
2015-03-13 10:14:12,256 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:12,256 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60689 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,256 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63789, dest: /127.0.0.1:60696, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 1901000
2015-03-13 10:14:12,257 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,257 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,257 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63788, dest: /127.0.0.1:60693, bytes: 98242, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_735567336_9, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 2734000
2015-03-13 10:14:12,257 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:12,260 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742236_1412{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60689|RBW]]} size 0
2015-03-13 10:14:12,261 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml is closed by DFSClient_NONMAPREDUCE_735567336_9
2015-03-13 10:14:12,261 INFO mapreduce.JobSubmitter (JobSubmitter.java:printTokens(477)) - Submitting tokens for job: job_1426266260362_0034
2015-03-13 10:14:12,262 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034 dst=null perm=null
2015-03-13 10:14:12,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:12,263 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:12,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,264 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,265 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:12,266 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:12,268 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:12,269 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:12,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:12,270 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:12,271 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:12,272 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:12,273 INFO resourcemanager.ClientRMService (ClientRMService.java:submitApplication(322)) - Application with id 34 submitted by user soberoi
2015-03-13 10:14:12,273 INFO rmapp.RMAppImpl (RMAppImpl.java:transition(678)) - Storing application with id application_1426266260362_0034
2015-03-13 10:14:12,273 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi IP=10.1.1.144 OPERATION=Submit Application Request TARGET=ClientRMService RESULT=SUCCESS APPID=application_1426266260362_0034
2015-03-13 10:14:12,274 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(437)) - Storing info for app: application_1426266260362_0034
2015-03-13 10:14:12,273 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from NEW to NEW_SAVING
2015-03-13 10:14:12,274 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from NEW_SAVING to SUBMITTED
2015-03-13 10:14:12,274 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerAppAttempt(544)) - Registering app attempt : appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,274 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from NEW to SUBMITTED
2015-03-13 10:14:12,274 INFO capacity.LeafQueue (LeafQueue.java:activateApplications(721)) - Application application_1426266260362_0034 from user: soberoi activated in queue: default
2015-03-13 10:14:12,274 INFO capacity.LeafQueue (LeafQueue.java:addApplication(737)) - Application added - appId: application_1426266260362_0034 user: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue$User@6a96f613, leaf-queue: default #user-pending-applications: 0 #user-active-applications: 2 #queue-pending-applications: 0 #queue-active-applications: 2
2015-03-13 10:14:12,275 INFO capacity.ParentQueue (ParentQueue.java:addApplication(485)) - Application added - appId: application_1426266260362_0034 user: soberoi leaf-queue of parent: root #applications: 2
2015-03-13 10:14:12,275 INFO impl.YarnClientImpl (YarnClientImpl.java:submitApplication(174)) - Submitted application application_1426266260362_0034 to ResourceManager at /10.1.1.144:60709
2015-03-13 10:14:12,275 INFO capacity.CapacityScheduler (CapacityScheduler.java:addApplication(457)) - Application Submission: appattempt_1426266260362_0034_000001, user: soberoi queue: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1, currently active: 2
2015-03-13 10:14:12,275 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from SUBMITTED to SCHEDULED
2015-03-13 10:14:12,276 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from SUBMITTED to ACCEPTED
2015-03-13 10:14:12,277 INFO mapreduce.Job (Job.java:submit(1272)) - The url to track the job: http://Edinburgh.local:60706/proxy/application_1426266260362_0034/
2015-03-13 10:14:12,277 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] submitted hadoop job: job_1426266260362_0034
2015-03-13 10:14:12,277 INFO flow.FlowStep (BaseFlowStep.java:logInfo(834)) - [lhs*rhs] tracking url: http://Edinburgh.local:60706/proxy/application_1426266260362_0034/
2015-03-13 10:14:12,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:12,279 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:12,334 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:12,335 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:12,335 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:12,335 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 2 containers, <memory:4096, vCores:2> used and <memory:0, vCores:6> available
2015-03-13 10:14:12,335 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] containerId=container_1426266260362_0034_01_000001 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:2048, vCores:1>usedCapacity=0.125, absoluteUsedCapacity=0.125, numApps=2, numContainers=1 usedCapacity=0.125 absoluteUsedCapacity=0.125 used=<memory:2048, vCores:1> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:12,335 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2
2015-03-13 10:14:12,335 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:12,335 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:12,336 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:storeAttempt(1278)) - Storing attempt: AppId: application_1426266260362_0034 AttemptId: appattempt_1426266260362_0034_000001 MasterContainer: Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ]
2015-03-13 10:14:12,336 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from SCHEDULED to ALLOCATED_SAVING
2015-03-13 10:14:12,336 INFO recovery.RMStateStore (RMStateStore.java:handleStoreEvent(468)) - Storing info for attempt: appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,336 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from ALLOCATED_SAVING to ALLOCATED
2015-03-13 10:14:12,337 INFO amlauncher.AMLauncher (AMLauncher.java:run(248)) - Launching masterappattempt_1426266260362_0034_000001
2015-03-13 10:14:12,337 INFO amlauncher.AMLauncher (AMLauncher.java:launch(105)) - Setting up container Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,337 INFO amlauncher.AMLauncher (AMLauncher.java:createAMContainerLaunchContext(190)) - Command to launch container container_1426266260362_0034_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr
2015-03-13 10:14:12,347 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:12,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000001 by user soberoi
2015-03-13 10:14:12,348 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:12,348 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000001
2015-03-13 10:14:12,348 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:12,348 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000001 to application application_1426266260362_0034
2015-03-13 10:14:12,348 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:12,348 INFO amlauncher.AMLauncher (AMLauncher.java:launch(126)) - Done launching container Container: [ContainerId: container_1426266260362_0034_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] for AM appattempt_1426266260362_0034_000001
2015-03-13 10:14:12,349 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from ALLOCATED to LAUNCHED
2015-03-13 10:14:12,349 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from NEW to LOCALIZING
2015-03-13 10:14:12,349 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:12,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:12,349 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000001
2015-03-13 10:14:12,358 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0034_01_000001.tokens. Credentials list:
2015-03-13 10:14:12,376 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:12,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/nmPrivate/container_1426266260362_0034_01_000001.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001.tokens
2015-03-13 10:14:12,447 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:12,480 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742228_1404
2015-03-13 10:14:12,481 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:12,481 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,482 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:12,482 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:12,505 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,507 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:12,513 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 509000
2015-03-13 10:14:12,532 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,547 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:12,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:12,548 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:12,554 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63795, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 163000
2015-03-13 10:14:12,567 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,584 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,585 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split dst=null perm=null
2015-03-13 10:14:12,590 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 1798, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410, duration: 169000
2015-03-13 10:14:12,603 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.split transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,620 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:12,621 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:12,622 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:12,628 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63794, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_65866444_18206, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 271000
2015-03-13 10:14:12,640 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:12,640 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:12,665 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000001 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:12,665 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:12,685 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:12,685 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:12,686 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:12,686 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:12,686 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:12,687 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742232_1408
2015-03-13 10:14:12,730 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000001/default_container_executor.sh]
2015-03-13 10:14:13,186 INFO BlockStateChange (BlockManager.java:computeReplicationWorkForBlocks(1352)) - BLOCK* ask 127.0.0.1:60686 to replicate blk_1073742233_1409 to datanode(s) 127.0.0.1:60696
2015-03-13 10:14:13,186 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60696 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742227_1403, blk_1073742223_1399]
2015-03-13 10:14:13,186 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60689 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742227_1403, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:13,338 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:13,339 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:13,339 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000001 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:13,715 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:13,715 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:13,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:13,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:13,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:13,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:13,716 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data3/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:13,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:13,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:13,717 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data4/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:13,739 INFO datanode.DataNode (DataNode.java:transferBlock(1319)) - DatanodeRegistration(127.0.0.1, storageID=DS-1907321454-10.1.1.144-60686-1426266259166, infoPort=60687, ipcPort=60688, storageInfo=lv=-47;cid=testClusterID;nsid=799921817;c=0) Starting thread to transfer BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 to 127.0.0.1:60696
2015-03-13 10:14:13,741 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63796 dest: /127.0.0.1:60696
2015-03-13 10:14:13,741 INFO datanode.DataNode (DataNode.java:run(1523)) - DataTransfer: Transmitted BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 (numBytes=254067) to /127.0.0.1:60696
2015-03-13 10:14:13,742 INFO datanode.DataNode (DataXceiver.java:writeBlock(594)) - Received BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409 src: /127.0.0.1:63796 dest: /127.0.0.1:60696 of size 254067
2015-03-13 10:14:13,743 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742233_1409 size 254067
2015-03-13 10:14:14,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:14,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:14,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:14,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:14,135 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:14,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:14,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data8/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:14,136 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:14,137 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:14,137 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data7/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:14,267 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging dst=null perm=null
2015-03-13 10:14:14,289 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_STARTED dst=null perm=null
2015-03-13 10:14:14,290 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_SUCCESS dst=null perm=null
2015-03-13 10:14:14,291 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/COMMIT_FAIL dst=null perm=null
2015-03-13 10:14:14,343 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:14,343 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034 dst=null perm=null
2015-03-13 10:14:14,344 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:14,345 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate dst=null perm=null
2015-03-13 10:14:14,346 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/history/done_intermediate/soberoi dst=null perm=null
2015-03-13 10:14:14,623 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:14,630 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.splitmetainfo dst=null perm=null
2015-03-13 10:14:14,686 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63798, bytes: 187, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411, duration: 194000
2015-03-13 10:14:15,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:15,349 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:15,481 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:15,482 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:registerApplicationMaster(255)) - AM registration appattempt_1426266260362_0034_000001
2015-03-13 10:14:15,483 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(119)) - USER=soberoi IP=10.1.1.144 OPERATION=Register App Master TARGET=ApplicationMasterService RESULT=SUCCESS APPID=application_1426266260362_0034 APPATTEMPTID=appattempt_1426266260362_0034_000001
2015-03-13 10:14:15,483 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0034_000001 State change from LAUNCHED to RUNNING
2015-03-13 10:14:15,483 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0034 State change from ACCEPTED to RUNNING
2015-03-13 10:14:15,506 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1.jhist dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:15,508 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=mkdirs src=/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/output/hadoop2-mr1/joinfieldedpipesplatform/samepipearoundgroupby/_temporary/1 dst=null perm=soberoi:supergroup:rwxrwxrwx
2015-03-13 10:14:15,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=create src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml dst=null perm=soberoi:supergroup:rw-rw-rw-
2015-03-13 10:14:15,712 INFO hdfs.StateChange (FSNamesystem.java:saveAllocatedBlock(2848)) - BLOCK* allocateBlock: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml. BP-1005356445-10.1.1.144-1426266257849 blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]}
2015-03-13 10:14:15,750 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63804 dest: /127.0.0.1:60693
2015-03-13 10:14:15,752 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63805 dest: /127.0.0.1:60696
2015-03-13 10:14:15,753 INFO datanode.DataNode (DataXceiver.java:writeBlock(432)) - Receiving BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413 src: /127.0.0.1:63806 dest: /127.0.0.1:60686
2015-03-13 10:14:15,760 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63806, dest: /127.0.0.1:60686, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 5029000
2015-03-13 10:14:15,760 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=LAST_IN_PIPELINE, downstreams=0:[] terminating
2015-03-13 10:14:15,760 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60686 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,760 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63805, dest: /127.0.0.1:60696, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 5571000
2015-03-13 10:14:15,761 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:15,761 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60696 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,761 INFO DataNode.clienttrace (BlockReceiver.java:run(1035)) - src: /127.0.0.1:63804, dest: /127.0.0.1:60693, bytes: 91045, op: HDFS_WRITE, cliID: DFSClient_NONMAPREDUCE_772751086_1, offset: 0, srvID: DS-1589780806-10.1.1.144-60693-1426266259390, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, duration: 6437000
2015-03-13 10:14:15,761 INFO datanode.DataNode (BlockReceiver.java:run(1118)) - PacketResponder: BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413, type=HAS_DOWNSTREAM_IN_PIPELINE terminating
2015-03-13 10:14:15,762 INFO BlockStateChange (BlockManager.java:logAddStoredBlock(2237)) - BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:60693 is added to blk_1073742237_1413{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[127.0.0.1:60693|RBW], ReplicaUnderConstruction[127.0.0.1:60696|RBW], ReplicaUnderConstruction[127.0.0.1:60686|RBW]]} size 0
2015-03-13 10:14:15,765 INFO hdfs.StateChange (FSNamesystem.java:completeFile(2789)) - DIR* completeFile: /tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job_1426266260362_0034_1_conf.xml is closed by DFSClient_NONMAPREDUCE_772751086_1
2015-03-13 10:14:15,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:15,936 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742229_1405
2015-03-13 10:14:15,937 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742231_1407
2015-03-13 10:14:16,138 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:16,139 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:16,139 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742230_1406
2015-03-13 10:14:16,139 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:16,189 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60686 to delete [blk_1073742224_1400, blk_1073742225_1401, blk_1073742226_1402, blk_1073742227_1403, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:16,189 INFO hdfs.StateChange (InvalidateBlocks.java:invalidateWork(152)) - BLOCK* InvalidateBlocks: ask 127.0.0.1:60693 to delete [blk_1073742224_1400, blk_1073742226_1402, blk_1073742228_1404, blk_1073742223_1399]
2015-03-13 10:14:16,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:16,350 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:16,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:16,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225 for deletion
2015-03-13 10:14:16,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:16,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227 for deletion
2015-03-13 10:14:16,740 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:16,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742225_1401 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742225
2015-03-13 10:14:16,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:16,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:16,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:16,741 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742227_1403 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742227
2015-03-13 10:14:16,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data1/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:16,742 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data2/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:16,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224 for deletion
2015-03-13 10:14:16,949 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226 for deletion
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228 for deletion
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742224_1400 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742224
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:deleteAsync(157)) - Scheduling blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223 for deletion
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742226_1402 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742226
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742223_1399 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data5/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742223
2015-03-13 10:14:16,950 INFO impl.FsDatasetAsyncDiskService (FsDatasetAsyncDiskService.java:run(201)) - Deleted BP-1005356445-10.1.1.144-1426266257849 blk_1073742228_1404 file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/build/test/data/dfs/data/data6/current/BP-1005356445-10.1.1.144-1426266257849/current/finalized/blk_1073742228
2015-03-13 10:14:17,003 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,003 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:17,003 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000002 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:17,004 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000002, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000002 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:4096, vCores:2>usedCapacity=0.25, absoluteUsedCapacity=0.25, numApps=2, numContainers=2 usedCapacity=0.25 absoluteUsedCapacity=0.25 used=<memory:4096, vCores:2> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,004 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3
2015-03-13 10:14:17,004 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,004 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,004 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:17,004 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000003 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 2 containers, <memory:2048, vCores:2> used and <memory:2048, vCores:6> available
2015-03-13 10:14:17,005 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000003, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000003 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:5120, vCores:3>usedCapacity=0.3125, absoluteUsedCapacity=0.3125, numApps=2, numContainers=3 usedCapacity=0.3125 absoluteUsedCapacity=0.3125 used=<memory:5120, vCores:3> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,005 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4
2015-03-13 10:14:17,005 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,005 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:17,005 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000004 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 3 containers, <memory:3072, vCores:3> used and <memory:1024, vCores:5> available
2015-03-13 10:14:17,006 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000004, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000004 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:6144, vCores:4>usedCapacity=0.375, absoluteUsedCapacity=0.375, numApps=2, numContainers=4 usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:6144, vCores:4> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5
2015-03-13 10:14:17,006 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,006 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,006 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:17,007 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000005 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60711, which currently has 4 containers, <memory:4096, vCores:4> used and <memory:0, vCores:4> available
2015-03-13 10:14:17,007 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000005, NodeId: 10.1.1.144:60711, NodeHttpAddress: 10.1.1.144:60714, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60711 }, ] containerId=container_1426266260362_0034_01_000005 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:5>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=5 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:5> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,007 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6
2015-03-13 10:14:17,007 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,152 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,153 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412
2015-03-13 10:14:17,195 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from NEW to ALLOCATED
2015-03-13 10:14:17,195 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Allocated Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:17,196 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:allocateContainer(116)) - Assigned container container_1426266260362_0034_01_000006 of capacity <memory:1024, vCores:1> on host 10.1.1.144:60715, which currently has 1 containers, <memory:1024, vCores:1> used and <memory:3072, vCores:7> available
2015-03-13 10:14:17,196 INFO capacity.LeafQueue (LeafQueue.java:assignContainer(1366)) - assignedContainer application=application_1426266260362_0034 container=Container: [ContainerId: container_1426266260362_0034_01_000006, NodeId: 10.1.1.144:60715, NodeHttpAddress: 10.1.1.144:60718, Resource: <memory:1024, vCores:1>, Priority: 20, Token: Token { kind: ContainerToken, service: 10.1.1.144:60715 }, ] containerId=container_1426266260362_0034_01_000006 queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:8192, vCores:6>usedCapacity=0.5, absoluteUsedCapacity=0.5, numApps=2, numContainers=6 usedCapacity=0.5 absoluteUsedCapacity=0.5 used=<memory:8192, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,196 INFO capacity.ParentQueue (ParentQueue.java:assignContainersToChildQueues(658)) - Re-sorting assigned queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:9216, vCores:7>usedCapacity=0.5625, absoluteUsedCapacity=0.5625, numApps=2, numContainers=7
2015-03-13 10:14:17,196 INFO capacity.ParentQueue (ParentQueue.java:assignContainers(573)) - assignedContainer queue=root usedCapacity=0.5625 absoluteUsedCapacity=0.5625 used=<memory:9216, vCores:7> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,269 INFO launcher.ContainerLaunch (ContainerLaunch.java:call(322)) - Container container_1426266260362_0033_01_000001 succeeded
2015-03-13 10:14:17,269 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from RUNNING to EXITED_WITH_SUCCESS
2015-03-13 10:14:17,269 INFO launcher.ContainerLaunch (ContainerLaunch.java:cleanupContainer(341)) - Cleaning up container container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi OPERATION=Container Finished - Succeeded TARGET=ContainerImpl RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0033_01_000001 transitioned from EXITED_WITH_SUCCESS to DONE
2015-03-13 10:14:17,278 INFO application.Application (ApplicationImpl.java:transition(340)) - Removing container_1426266260362_0033_01_000001 from application application_1426266260362_0033
2015-03-13 10:14:17,278 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,278 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_STOP for appId application_1426266260362_0033
2015-03-13 10:14:17,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0033/container_1426266260362_0033_01_000001
2015-03-13 10:14:17,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 33 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_COMPLETE diagnostics: "" exit_status: 0
2015-03-13 10:14:17,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(324)) - Removed completed container container_1426266260362_0033_01_000001
2015-03-13 10:14:17,354 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:17,354 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0033_01_000001 Container Transitioned from RUNNING to COMPLETED
2015-03-13 10:14:17,354 INFO resourcemanager.ApplicationMasterService (ApplicationMasterService.java:unregisterAttempt(550)) - Unregistering app attempt : appattempt_1426266260362_0033_000001
2015-03-13 10:14:17,354 INFO fica.FiCaSchedulerApp (FiCaSchedulerApp.java:containerCompleted(252)) - Completed container: container_1426266260362_0033_01_000001 in state: COMPLETED event:FINISHED
2015-03-13 10:14:17,355 INFO attempt.RMAppAttemptImpl (RMAppAttemptImpl.java:handle(632)) - appattempt_1426266260362_0033_000001 State change from FINISHING to FINISHED
2015-03-13 10:14:17,355 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(98)) - USER=soberoi OPERATION=AM Released Container TARGET=SchedulerApp RESULT=SUCCESS APPID=application_1426266260362_0033 CONTAINERID=container_1426266260362_0033_01_000001
2015-03-13 10:14:17,355 INFO rmapp.RMAppImpl (RMAppImpl.java:handle(578)) - application_1426266260362_0033 State change from FINISHING to FINISHED
2015-03-13 10:14:17,355 INFO fica.FiCaSchedulerNode (FiCaSchedulerNode.java:releaseContainer(164)) - Released container container_1426266260362_0033_01_000001 of capacity <memory:2048, vCores:1> on host 10.1.1.144:60723, which currently has 1 containers, <memory:2048, vCores:1> used and <memory:2048, vCores:7> available, release resources=true
2015-03-13 10:14:17,355 INFO capacity.LeafQueue (LeafQueue.java:releaseResource(1509)) - default used=<memory:7168, vCores:6> numContainers=6 user=soberoi user-resources=<memory:7168, vCores:6>
2015-03-13 10:14:17,355 INFO amlauncher.AMLauncher (AMLauncher.java:run(262)) - Cleaning master appattempt_1426266260362_0033_000001
2015-03-13 10:14:17,355 INFO resourcemanager.RMAuditLogger (RMAuditLogger.java:logSuccess(140)) - USER=soberoi OPERATION=Application Finished - Succeeded TARGET=RMAppManager RESULT=SUCCESS APPID=application_1426266260362_0033
2015-03-13 10:14:17,355 INFO capacity.LeafQueue (LeafQueue.java:completedContainer(1451)) - completedContainer container=Container: [ContainerId: container_1426266260362_0033_01_000001, NodeId: 10.1.1.144:60723, NodeHttpAddress: 10.1.1.144:60726, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 10.1.1.144:60723 }, ] resource=<memory:2048, vCores:1> queue=default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6 usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,355 INFO resourcemanager.RMAppManager$ApplicationSummary (RMAppManager.java:logAppSummary(166)) - appId=application_1426266260362_0033,name=[2C202E1F11CB4F72A241D80B1FC5F547/2FBAD5263615431A999A5D504C8EA30E] lhs*rhs/(2/2),user=soberoi,queue=default,state=FINISHED,trackingUrl=Edinburgh.local:60706/proxy/application_1426266260362_0033/jobhistory/job/job_1426266260362_0033,appMasterHost=Edinburgh.local,startTime=1426266830871,finishTime=1426266851120,finalStatus=SUCCEEDED
2015-03-13 10:14:17,355 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(697)) - completedContainer queue=root usedCapacity=0.4375 absoluteUsedCapacity=0.4375 used=<memory:7168, vCores:6> cluster=<memory:16384, vCores:32>
2015-03-13 10:14:17,355 INFO capacity.ParentQueue (ParentQueue.java:completedContainer(711)) - Re-sorting completed queue: root.default stats: default: capacity=1.0, absoluteCapacity=1.0, usedResources=<memory:7168, vCores:6>usedCapacity=0.4375, absoluteUsedCapacity=0.4375, numApps=2, numContainers=6
2015-03-13 10:14:17,355 INFO capacity.CapacityScheduler (CapacityScheduler.java:completedContainer(841)) - Application appattempt_1426266260362_0033_000001 released container container_1426266260362_0033_01_000001 on node: host: 10.1.1.144:60723 #containers=1 available=2048 used=2048 with event: FINISHED
2015-03-13 10:14:17,356 INFO capacity.CapacityScheduler (CapacityScheduler.java:doneApplication(470)) - Application appattempt_1426266260362_0033_000001 is done. finalState=FINISHED
2015-03-13 10:14:17,356 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:clearRequests(108)) - Application application_1426266260362_0033 requests cleared
2015-03-13 10:14:17,356 INFO capacity.LeafQueue (LeafQueue.java:removeApplication(779)) - Application removed - appId: application_1426266260362_0033 user: soberoi queue: default #user-pending-applications: 0 #user-active-applications: 1 #queue-pending-applications: 0 #queue-active-applications: 1
2015-03-13 10:14:17,356 INFO capacity.ParentQueue (ParentQueue.java:removeApplication(510)) - Application removed - appId: application_1426266260362_0033 user: soberoi leaf-queue of parent: root #applications: 1
2015-03-13 10:14:17,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:17,356 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742234_1410
2015-03-13 10:14:17,357 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742235_1411
2015-03-13 10:14:17,357 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0033_000001 (auth:SIMPLE)
2015-03-13 10:14:17,358 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:stopContainerInternal(704)) - Stopping container with container Id: container_1426266260362_0033_01_000001
2015-03-13 10:14:17,488 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,517 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,518 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from ALLOCATED to ACQUIRED
2015-03-13 10:14:17,553 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,554 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,563 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,564 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,566 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:17,567 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:17,573 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:17,574 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:17,575 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/MRAppJar.jar dst=null perm=null
2015-03-13 10:14:17,576 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/user/soberoi/target/Hadoop2MR1Platform-tmpDir/hadoop-4877563449830040240.jar dst=null perm=null
2015-03-13 10:14:17,650 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:17,650 INFO ipc.Server (Server.java:saslProcess(1342)) - Auth successful for appattempt_1426266260362_0034_000001 (auth:SIMPLE)
2015-03-13 10:14:17,653 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000006 by user soberoi
2015-03-13 10:14:17,653 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000003 by user soberoi
2015-03-13 10:14:17,654 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:17,654 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000005 by user soberoi
2015-03-13 10:14:17,654 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000003
2015-03-13 10:14:17,653 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(596)) - Creating a new application reference for app application_1426266260362_0034
2015-03-13 10:14:17,654 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:17,654 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000005
2015-03-13 10:14:17,654 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000004 by user soberoi
2015-03-13 10:14:17,654 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from NEW to INITING
2015-03-13 10:14:17,655 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000004
2015-03-13 10:14:17,654 INFO containermanager.ContainerManagerImpl (ContainerManagerImpl.java:startContainerInternal(556)) - Start request for container_1426266260362_0034_01_000002 by user soberoi
2015-03-13 10:14:17,655 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000002
2015-03-13 10:14:17,655 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000006 to application application_1426266260362_0034
2015-03-13 10:14:17,655 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:17,656 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,656 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,656 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,656 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,656 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,654 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000003 to application application_1426266260362_0034
2015-03-13 10:14:17,656 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,656 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,654 INFO nodemanager.NMAuditLogger (NMAuditLogger.java:logSuccess(89)) - USER=soberoi IP=10.1.1.144 OPERATION=Start Container Request TARGET=ContainerManageImpl RESULT=SUCCESS APPID=application_1426266260362_0034 CONTAINERID=container_1426266260362_0034_01_000006
2015-03-13 10:14:17,656 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000006
2015-03-13 10:14:17,656 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000005 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000004 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO application.Application (ApplicationImpl.java:transition(297)) - Adding container_1426266260362_0034_01_000002 to application application_1426266260362_0034
2015-03-13 10:14:17,657 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0034 transitioned from INITING to RUNNING
2015-03-13 10:14:17,657 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,657 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,657 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,658 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from NEW to LOCALIZING
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,658 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,658 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,658 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from INIT to DOWNLOADING
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,658 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,658 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,659 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event CONTAINER_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_INIT for appId application_1426266260362_0034
2015-03-13 10:14:17,659 INFO containermanager.AuxServices (AuxServices.java:handle(179)) - Got APPLICATION_INIT for service mapreduce_shuffle
2015-03-13 10:14:17,659 INFO mapred.ShuffleHandler (ShuffleHandler.java:initializeApplication(259)) - Added token for job_1426266260362_0034
2015-03-13 10:14:17,659 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000003
2015-03-13 10:14:17,660 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000005
2015-03-13 10:14:17,660 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000002
2015-03-13 10:14:17,661 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:handle(590)) - Created localizer for container_1426266260362_0034_01_000004
2015-03-13 10:14:17,683 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0034_01_000006.tokens. Credentials list:
2015-03-13 10:14:17,683 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0034_01_000003.tokens. Credentials list:
2015-03-13 10:14:17,684 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000002.tokens. Credentials list:
2015-03-13 10:14:17,690 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000004.tokens. Credentials list:
2015-03-13 10:14:17,690 INFO localizer.ResourceLocalizationService (ResourceLocalizationService.java:writeCredentials(1011)) - Writing credentials to the nmPrivate file /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0034_01_000005.tokens. Credentials list:
2015-03-13 10:14:17,702 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:17,703 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:17,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/nmPrivate/container_1426266260362_0034_01_000006.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006.tokens
2015-03-13 10:14:17,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/nmPrivate/container_1426266260362_0034_01_000003.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003.tokens
2015-03-13 10:14:17,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:17,776 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:17,844 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,845 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,846 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,847 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar dst=null perm=null
2015-03-13 10:14:17,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60686, dest: /127.0.0.1:63815, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1314223018_18354, offset: 0, srvID: DS-1907321454-10.1.1.144-60686-1426266259166, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 512000
2015-03-13 10:14:17,854 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60689, dest: /127.0.0.1:63814, bytes: 256055, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_583988668_18355, offset: 0, srvID: DS-1172757413-10.1.1.144-60689-1426266259165, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409, duration: 516000
2015-03-13 10:14:17,873 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,873 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.jar transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,891 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,892 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=getfileinfo src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,893 INFO FSNamesystem.audit (FSNamesystem.java:logAuditEvent(6725)) - allowed=true ugi=soberoi (auth:SIMPLE) ip=/127.0.0.1 cmd=open src=/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml dst=null perm=null
2015-03-13 10:14:17,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742233_1409
2015-03-13 10:14:17,895 INFO datanode.BlockPoolSliceScanner (BlockPoolSliceScanner.java:verifyBlock(429)) - Verification succeeded for BP-1005356445-10.1.1.144-1426266257849:blk_1073742237_1413
2015-03-13 10:14:17,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63816, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_-1314223018_18354, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 292000
2015-03-13 10:14:17,899 INFO DataNode.clienttrace (BlockSender.java:sendBlock(732)) - src: /127.0.0.1:60696, dest: /127.0.0.1:63817, bytes: 99010, op: HDFS_READ, cliID: DFSClient_NONMAPREDUCE_583988668_18355, offset: 0, srvID: DS-318492837-10.1.1.144-60696-1426266259571, blockid: BP-1005356445-10.1.1.144-1426266257849:blk_1073742236_1412, duration: 250000
2015-03-13 10:14:17,913 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,913 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,913 INFO localizer.LocalizedResource (LocalizedResource.java:handle(196)) - Resource hdfs://localhost:60685/tmp/hadoop-yarn/staging/soberoi/.staging/job_1426266260362_0034/job.xml transitioned from DOWNLOADING to LOCALIZED
2015-03-13 10:14:17,914 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,914 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from LOCALIZING to LOCALIZED
2015-03-13 10:14:17,965 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000003 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,965 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,972 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000006 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,972 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,972 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000004 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,972 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,973 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000005 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,973 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:17,973 INFO container.Container (ContainerImpl.java:handle(871)) - Container container_1426266260362_0034_01_000002 transitioned from LOCALIZED to RUNNING
2015-03-13 10:14:17,973 INFO monitor.ContainersMonitorImpl (ContainersMonitorImpl.java:isEnabled(159)) - ResourceCalculatorPlugin is unavailable on this system. org.apache.hadoop.yarn.server.nodemanager.containermanager.monitor.ContainersMonitorImpl is disabled.
2015-03-13 10:14:18,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,004 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000002 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000003 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000004 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,005 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000005 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,005 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,006 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,006 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,006 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,006 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,006 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,102 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_3/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000003/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002/default_container_executor.sh]
2015-03-13 10:14:18,110 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005/default_container_executor.sh]
2015-03-13 10:14:18,138 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(189)) - launchContainer: [nice, -n, 0, bash, /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000006/default_container_executor.sh]
2015-03-13 10:14:18,195 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,196 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,196 INFO rmcontainer.RMContainerImpl (RMContainerImpl.java:handle(220)) - container_1426266260362_0034_01_000006 Container Transitioned from ACQUIRED to RUNNING
2015-03-13 10:14:18,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,196 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-1_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,196 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,355 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:18,355 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from RUNNING to APPLICATION_RESOURCES_CLEANINGUP
2015-03-13 10:14:18,355 INFO containermanager.AuxServices (AuxServices.java:handle(175)) - Got event APPLICATION_STOP for appId application_1426266260362_0033
2015-03-13 10:14:18,356 INFO application.Application (ApplicationImpl.java:handle(451)) - Application application_1426266260362_0033 transitioned from APPLICATION_RESOURCES_CLEANINGUP to FINISHED
2015-03-13 10:14:18,356 INFO loghandler.NonAggregatingLogHandler (NonAggregatingLogHandler.java:handle(118)) - Scheduling Log Deletion for application: application_1426266260362_0033, with delay of 10800 seconds
2015-03-13 10:14:18,356 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_0/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_1/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_3/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,357 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:deleteAsUser(368)) - Deleting absolute path : /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-3_2/usercache/soberoi/appcache/application_1426266260362_0033
2015-03-13 10:14:18,532 INFO scheduler.AppSchedulingInfo (AppSchedulingInfo.java:updateResourceRequests(166)) - checking for deactivate...
2015-03-13 10:14:18,944 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,007 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,060 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_1/nmPrivate/container_1426266260362_0034_01_000005.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000005.tokens
2015-03-13 10:14:19,060 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:19,163 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,200 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000004.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000004.tokens
2015-03-13 10:14:19,278 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:19,357 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:19,375 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:createUserCacheDirs(468)) - Initializing user soberoi
2015-03-13 10:14:19,501 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(103)) - Copying from /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/nmPrivate/container_1426266260362_0034_01_000002.tokens to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034/container_1426266260362_0034_01_000002.tokens
2015-03-13 10:14:19,501 INFO nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:startLocalizer(105)) - CWD set to /Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034 = file:/Users/soberoi/src/compatibility/cascading.compatibility/pivotal/target/Hadoop2MR1Platform/Hadoop2MR1Platform-localDir-nm-0_0/usercache/soberoi/appcache/application_1426266260362_0034
2015-03-13 10:14:20,011 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,011 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,011 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,012 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,201 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:20,361 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,016 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,017 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,202 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:21,365 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,020 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,206 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:22,366 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,021 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,022 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,211 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:23,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,027 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 4 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,028 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 5 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,215 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 6 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:24,367 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 1 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,029 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 2 } state: C_RUNNING diagnostics: "" exit_status: -1000
2015-03-13 10:14:25,030 INFO nodemanager.NodeStatusUpdaterImpl (NodeStatusUpdaterImpl.java:getNodeStatusAndUpdateContainersInContext(314)) - Sending out status for container: container_id { app_attempt_id { application_id { id: 34 cluster_timestamp: 1426266260362 } attemptId: 1 } id: 3 } state: C_RUNNING diagnostics: ""